Oct 30 19:24:23.443952 ip-10-0-130-34 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 19:24:23.992488 ip-10-0-130-34 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:24:23.992488 ip-10-0-130-34 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 19:24:23.992488 ip-10-0-130-34 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:24:23.992488 ip-10-0-130-34 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:24:23.998944 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998839    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:24:23.998944 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998938    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:24:23.998944 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998941    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:24:23.998944 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998945    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:24:23.998944 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998948    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:24:23.998944 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998951    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:24:23.998944 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998954    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998957    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998963    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998968    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998972    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998975    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998978    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998981    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998984    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998987    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998990    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998992    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998995    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.998997    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999005    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999007    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999010    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999013    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999016    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:24:23.999137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999018    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999021    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999023    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999026    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999030    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999034    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999037    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999039    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999042    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999045    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999048    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999050    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999053    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999056    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999059    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999062    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999065    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999067    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999070    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:24:23.999578 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999073    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999076    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999078    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999081    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999083    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999086    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999089    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999091    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999093    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999096    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999099    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999101    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999104    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999106    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999109    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999111    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999114    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999116    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999119    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:24:24.000084 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999121    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999124    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999126    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999129    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999131    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999133    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999136    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999139    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999142    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999146    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999149    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999151    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999154    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999157    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999159    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999162    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999165    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999168    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999170    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999173    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:24:24.000521 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999175    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999178    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999181    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999184    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999186    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999189    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999191    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999194    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999196    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999199    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999201    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999203    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999207    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999209    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999212    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999214    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999216    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999219    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999221    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999230    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:24:24.001008 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999233    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999235    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:23.999239    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000085    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000092    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000096    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000099    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000102    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000105    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000107    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000111    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000115    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000119    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000122    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000125    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000128    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000130    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000133    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:24:24.001495 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000136    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000138    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000140    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000144    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000149    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000152    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000156    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000159    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000162    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000164    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000167    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000170    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000172    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000175    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000177    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000180    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000182    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000185    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000188    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:24:24.001938 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000191    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000193    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000196    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000198    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000201    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000203    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000206    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000208    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000210    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000213    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000215    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000218    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000220    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000223    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000226    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000228    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000231    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000233    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000237    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000239    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:24:24.002396 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000242    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000244    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000247    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000250    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000252    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000255    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000257    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000260    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000262    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000265    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000267    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000270    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000273    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000275    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000278    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000280    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000283    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000285    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000287    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000290    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:24:24.002892 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000292    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000295    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000297    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000300    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000302    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000305    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000307    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000310    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000312    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000315    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000317    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000319    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000322    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000324    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000327    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000330    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000332    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000335    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000337    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000339    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:24:24.003360 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000342    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000345    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000347    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000350    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000353    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000355    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000358    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000361    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000363    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000365    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000368    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000370    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000904    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000910    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000913    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000915    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000918    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000921    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000923    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000926    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:24:24.003858 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000928    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000931    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000933    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000936    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000938    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000941    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000944    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000946    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000949    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000951    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000954    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000957    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000959    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000962    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000965    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000969    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000974    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000977    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000979    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000986    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:24:24.004319 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000989    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000991    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000994    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000997    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.000999    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001002    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001004    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001007    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001010    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001013    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001015    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001018    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001020    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001023    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001026    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001028    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001031    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001036    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001038    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001041    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:24:24.004808 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001043    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001046    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001048    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001051    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001053    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001056    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001059    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001061    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001064    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001068    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001070    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001073    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001076    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001078    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001081    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001083    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001088    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001091    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001094    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:24:24.005343 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001098    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001100    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001103    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001105    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001108    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001110    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001113    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001115    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001117    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001120    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001124    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001127    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001129    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001132    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001135    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001137    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001140    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001143    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001146    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:24:24.005806 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001148    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001151    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001153    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001156    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001159    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001161    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001164    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001166    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001169    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001171    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001174    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001177    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001180    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001182    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001184    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001187    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001189    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001192    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001194    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.001196    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:24:24.006258 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002284    2583 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002301    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002309    2583 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002316    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002321    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002324    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002328    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002333    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002336    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002340    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002343    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002347    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002350    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002353    2583 flags.go:64] FLAG: --cgroup-root=""
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002356    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002359    2583 flags.go:64] FLAG: --client-ca-file=""
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002362    2583 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002365    2583 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002370    2583 flags.go:64] FLAG: --cluster-domain=""
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002373    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002376    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002379    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002382    2583 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002386    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 19:24:24.006776 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002389    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002392    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002395    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002399    2583 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002402    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002405    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002409    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002412    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002416    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002419    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002422    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002427    2583 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002430    2583 flags.go:64] FLAG: --enable-server="true"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002433    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002439    2583 flags.go:64] FLAG: --event-burst="100"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002442    2583 flags.go:64] FLAG: --event-qps="50"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002445    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002448    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002451    2583 flags.go:64] FLAG: --eviction-hard=""
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002456    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002459    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002462    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002465    2583 flags.go:64] FLAG: --eviction-soft=""
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002468    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002471    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 19:24:24.007324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002474    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002478    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002481    2583 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002483    2583 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002486    2583 flags.go:64] FLAG: --feature-gates=""
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002490    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002494    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002497    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002500    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002502    2583 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002505    2583 flags.go:64] FLAG: --help="false"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002508    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002512    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002515    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002518    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002521    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002525    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002528    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002531    2583 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002533    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002536    2583 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002539    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002542    2583 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002547    2583 flags.go:64] FLAG: --kube-reserved=""
Oct 30 19:24:24.007954 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002550    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002552    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002556    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002558    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002561    2583 flags.go:64] FLAG: --lock-file=""
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002564    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002567    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002571    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002577    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002580    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002583    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002586    2583 flags.go:64] FLAG: --logging-format="text"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002589    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002592    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002595    2583 flags.go:64] FLAG: --manifest-url=""
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002598    2583 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002603    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002606    2583 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002610    2583 flags.go:64] FLAG: --max-pods="110"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002613    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002616    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002619    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002622    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002625    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002628    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 19:24:24.008510 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002631    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002640    2583 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002658    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002661    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002664    2583 flags.go:64] FLAG: --pod-cidr=""
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002667    2583 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002672    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002675    2583 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002677    2583 flags.go:64] FLAG: --port="10250"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002681    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002684    2583 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-03a501831e32572b9"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002687    2583 flags.go:64] FLAG: --qos-reserved=""
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002690    2583 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002693    2583 flags.go:64] FLAG: --register-node="true"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002696    2583 flags.go:64] FLAG: --register-with-taints=""
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002700    2583 flags.go:64] FLAG: --registry-burst="10"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002703    2583 flags.go:64] FLAG: --registry-qps="5"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002706    2583 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002709    2583 flags.go:64] FLAG: --reserved-memory=""
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002713    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002716    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002720    2583 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002723    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002725    2583 flags.go:64] FLAG: --runonce="false"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002728    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002731    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002734    2583 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 19:24:24.009106 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002737    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002740    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002743    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002746    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002749    2583 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002752    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002755    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002757    2583 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002761    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002764    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002767    2583 flags.go:64] FLAG: --system-cgroups=""
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002772    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002777    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002780    2583 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002783    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002787    2583 flags.go:64] FLAG: --tls-min-version=""
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002790    2583 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002793    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002796    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002799    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002802    2583 flags.go:64] FLAG: --v="2"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002806    2583 flags.go:64] FLAG: --version="false"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002811    2583 flags.go:64] FLAG: --vmodule=""
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002815    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.002818    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 19:24:24.009819 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.002966    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.002971    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.002975    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.002978    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.002981    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.002983    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.002986    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.002988    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.002992    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.002995    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.002997    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003000    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003003    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003005    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003009    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003013    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003016    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003019    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003024    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:24:24.010538 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003027    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003029    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003032    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003035    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003037    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003040    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003043    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003045    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003048    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003050    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003053    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003055    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003058    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003061    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003064    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003066    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003069    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003071    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003073    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003076    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:24:24.011277 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003078    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003082    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003085    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003087    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003090    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003092    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003095    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003098    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003100    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003103    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003106    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003110    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003112    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003115    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003117    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003120    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003122    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003124    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003127    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:24:24.012090 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003130    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003132    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003135    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003137    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003140    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003142    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003144    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003148    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003150    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003153    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003155    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003158    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003160    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003163    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003166    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003169    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003171    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003174    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003176    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003179    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:24:24.012588 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003181    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003184    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003187    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003189    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003193    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003196    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003198    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003201    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003203    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003206    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003208    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003211    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003213    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003215    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003218    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003221    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003223    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003225    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003228    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:24:24.013190 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003230    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003233    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003236    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003238    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003241    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003243    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003246    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003250    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003252    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.003280    2583 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003321    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003326    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003329    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003332    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003335    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003337    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:24:24.013633 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003341    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003345    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003348    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003351    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003353    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003356    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003358    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003361    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003363    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003366    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003369    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003371    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003374    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003377    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003379    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003382    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003384    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003387    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003390    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:24:24.014034 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003393    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003396    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003398    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003401    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003403    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003407    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003410    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003412    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003415    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003417    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003420    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003423    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003425    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003428    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003431    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003434    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003436    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003439    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003441    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003444    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:24:24.014483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003446    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003449    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003451    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003454    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003456    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003458    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003461    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003463    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003466    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003468    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003471    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003473    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003476    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003479    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003481    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003483    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003486    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003490    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003492    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003495    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:24:24.014959 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003497    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003500    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003503    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003505    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003507    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003510    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003513    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003516    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003518    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003520    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003523    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003525    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003529    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003532    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003535    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003537    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003541    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003544    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003547    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:24:24.015428 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003549    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003552    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003554    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003557    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003559    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003561    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003565    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003568    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003571    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003574    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003578    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003580    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003583    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003585    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003587    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003590    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003592    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003595    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003597    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003601    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:24:24.015976 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003603    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.003606    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.012338    2583 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.012357    2583 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.013128    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.013135    2583 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013203    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013208    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013211    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013214    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013216    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013219    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013222    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013225    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013227    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013230    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013232    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013235    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013237    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:24:24.016461 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013240    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013243    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013245    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013248    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013250    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013253    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013255    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013258    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013260    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013263    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013266    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013269    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013271    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013274    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013278    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013280    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013283    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013286    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013289    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013291    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:24:24.016916 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013294    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013297    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013299    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013302    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013305    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013307    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013309    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013312    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013314    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013317    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013319    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013322    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013324    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013326    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013329    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013332    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013335    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013337    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013340    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:24:24.017375 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013342    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013345    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013347    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013349    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013352    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013355    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013357    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013360    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013363    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013366    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013368    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013371    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013375    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013379    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013383    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013385    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013388    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013391    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013393    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:24:24.017831 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013396    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013399    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013401    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013404    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013406    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013409    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013411    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013413    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013417    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013420    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013422    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013425    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013427    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013431    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013434    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013437    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013440    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013443    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013446    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:24:24.018283 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013448    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013451    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013454    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013457    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013460    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013463    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013465    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013468    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013471    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013473    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013476    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013478    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013481    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013483    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013486    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013489    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.013519    2583 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:24:24.018747 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013682    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013688    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013691    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013693    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013696    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013699    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013702    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013704    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013708    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013710    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013713    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013716    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013718    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013721    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013724    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013726    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013729    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013731    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013734    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013737    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:24:24.019137 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013739    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013742    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013744    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013747    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013749    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013752    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013755    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013757    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013760    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013762    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013765    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013767    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013770    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013772    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013774    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013777    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013779    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013782    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013785    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013787    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:24:24.019597 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013789    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013792    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013794    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013797    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013799    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013802    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013804    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013807    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013809    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013812    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013815    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013817    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013820    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013823    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013826    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013828    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013841    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013845    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013848    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:24:24.020136 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013851    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013853    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013856    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013858    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013861    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013863    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013866    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013868    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013871    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013874    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013876    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013878    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013882    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013886    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013890    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013893    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013896    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013899    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013901    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:24:24.020570 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013904    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013906    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013908    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013912    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013915    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013917    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013919    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013922    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013924    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013927    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013930    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013932    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013935    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013937    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013940    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013942    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013945    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013947    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:24:24.021025 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013949    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013952    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013955    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013958    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013960    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013963    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013965    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013967    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013970    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.013973    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.013999    2583 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014044    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014048    2583 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014051    2583 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014054    2583 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:24:24.021436 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014057    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014060    2583 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014062    2583 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014065    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014068    2583 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014070    2583 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014073    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014075    2583 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014078    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014081    2583 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014083    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014085    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014088    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014090    2583 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014093    2583 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014096    2583 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014098    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014101    2583 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014103    2583 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014106    2583 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:24:24.021800 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014109    2583 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014111    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014114    2583 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014116    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014118    2583 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014121    2583 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014124    2583 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014126    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014129    2583 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014131    2583 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014134    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014136    2583 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014138    2583 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014141    2583 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014143    2583 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014146    2583 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014148    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014151    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014153    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014156    2583 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:24:24.022275 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014158    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014160    2583 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014163    2583 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014165    2583 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014168    2583 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014170    2583 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014173    2583 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014175    2583 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014178    2583 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014180    2583 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014182    2583 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014185    2583 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014187    2583 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014190    2583 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014192    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014194    2583 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014197    2583 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014199    2583 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014202    2583 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014205    2583 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:24:24.022772 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014208    2583 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014210    2583 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014213    2583 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014215    2583 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014219    2583 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014222    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014225    2583 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014227    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014230    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014232    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014235    2583 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014238    2583 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014240    2583 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014243    2583 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014245    2583 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014247    2583 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014250    2583 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014252    2583 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014255    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:24:24.023239 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014257    2583 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014261    2583 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014264    2583 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014267    2583 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014270    2583 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014273    2583 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014275    2583 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014278    2583 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014280    2583 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014283    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014285    2583 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014288    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014291    2583 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014295    2583 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014297    2583 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014299    2583 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014302    2583 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014304    2583 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014307    2583 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:24:24.023734 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014309    2583 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:24:24.024198 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014312    2583 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:24:24.024198 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014314    2583 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:24:24.024198 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:24.014316    2583 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:24:24.024198 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.014381    2583 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 19:24:24.024198 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.016696    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 19:24:24.024198 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.018002    2583 server.go:1014] "Starting client certificate rotation"
Oct 30 19:24:24.024198 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.018106    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 19:24:24.024198 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.019023    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 19:24:24.024198 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.023154    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 19:24:24.024600 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.024581    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 19:24:24.035521 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.035501    2583 log.go:25] "Validated CRI v1 runtime API"
Oct 30 19:24:24.040009 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.039981    2583 log.go:25] "Validated CRI v1 image API"
Oct 30 19:24:24.040958 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.040936    2583 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 19:24:24.045449 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.045429    2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 80940766-87bd-40c7-a9f1-a664a92c7f02:/dev/nvme0n1p4 b03100a9-6352-4f48-b363-cc625be0a9dd:/dev/nvme0n1p3]
Oct 30 19:24:24.045490 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.045449    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 19:24:24.051061 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.050934    2583 manager.go:217] Machine: {Timestamp:2026-10-30 19:24:24.049369232 +0000 UTC m=+0.456990325 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3128690 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fc68cf2c9ef9d23bcfc968b1abd9c SystemUUID:ec2fc68c-f2c9-ef9d-23bc-fc968b1abd9c BootID:de90163d-0aeb-4223-be56-bc6509ac43f4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:cb:50:b5:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:cb:50:b5:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:b7:50:ea:23:83 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 19:24:24.051667 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.051657    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 19:24:24.051766 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.051755    2583 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 19:24:24.055628 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.055594    2583 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 19:24:24.055816 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.055630    2583 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-34.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 19:24:24.055859 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.055819    2583 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 19:24:24.055859 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.055828    2583 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 19:24:24.055912 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.055864    2583 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 19:24:24.055912 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.055883    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 19:24:24.056841 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.056827    2583 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 19:24:24.060497 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.060481    2583 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 19:24:24.060634 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.060624    2583 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 19:24:24.061458 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.061449    2583 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 19:24:24.061491 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.061462    2583 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 19:24:24.061491 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.061473    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 19:24:24.061491 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.061484    2583 kubelet.go:405] "Adding apiserver pod source"
Oct 30 19:24:24.061491 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.061493    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 19:24:24.061964 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.061950    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 19:24:24.065348 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.065319    2583 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 19:24:24.071050 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.071032    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 19:24:24.072205 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.072189    2583 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 19:24:24.072270 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.072231    2583 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 19:24:24.072431 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.072417    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 19:24:24.072538 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.072438    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 19:24:24.072538 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.072448    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 19:24:24.072538 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.072456    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 19:24:24.072538 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.072465    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 19:24:24.072538 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.072474    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 19:24:24.073307 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.073296    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 19:24:24.073356 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.073311    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 19:24:24.073356 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.073324    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 19:24:24.073356 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.073332    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 19:24:24.073356 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.073346    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 19:24:24.073501 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.073360    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 19:24:24.074319 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.074307    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 19:24:24.074379 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.074323    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 19:24:24.078408 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.078391    2583 server.go:1263] "Started kubelet"
Oct 30 19:24:24.078517 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.078452    2583 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 19:24:24.078563 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.078503    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 19:24:24.078601 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.078579    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 19:24:24.079313 ip-10-0-130-34 systemd[1]: Started Kubernetes Kubelet.
Oct 30 19:24:24.080198 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.080143    2583 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 19:24:24.081402 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.081387    2583 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 19:24:24.084567 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:24.084544    2583 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 19:24:24.086090 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.086071    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 19:24:24.086701 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.086685    2583 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 19:24:24.086849 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:24.086802    2583 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-34.us-west-2.compute.internal\" not found"
Oct 30 19:24:24.087461 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087443    2583 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 19:24:24.087461 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087445    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 19:24:24.087576 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087466    2583 factory.go:55] Registering systemd factory
Oct 30 19:24:24.087576 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087491    2583 factory.go:223] Registration of the systemd container factory successfully
Oct 30 19:24:24.087576 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087472    2583 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 19:24:24.087707 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087617    2583 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 19:24:24.087707 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087623    2583 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 19:24:24.087758 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087733    2583 factory.go:153] Registering CRI-O factory
Oct 30 19:24:24.087758 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087743    2583 factory.go:223] Registration of the crio container factory successfully
Oct 30 19:24:24.087825 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087783    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 19:24:24.087825 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087797    2583 factory.go:103] Registering Raw factory
Oct 30 19:24:24.087825 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.087806    2583 manager.go:1199] Started watching for new ooms in manager
Oct 30 19:24:24.088965 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.088949    2583 manager.go:319] Starting recovery of all containers
Oct 30 19:24:24.098903 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.098762    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 19:24:24.099810 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.099790    2583 manager.go:324] Recovery completed
Oct 30 19:24:24.105025 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.105013    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:24:24.106825 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.106806    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 19:24:24.106904 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.106842    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 19:24:24.106904 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.106856    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 19:24:24.107383 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.107370    2583 cpu_manager.go:226] "Starting" policy="none"
Oct 30 19:24:24.107452 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.107383    2583 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 19:24:24.107452 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.107403    2583 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 19:24:24.107452 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.107372    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:24:24.108110 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.108094    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 19:24:24.108192 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.108127    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 19:24:24.108192 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.108142    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 19:24:24.109031 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.109019    2583 policy_none.go:50] "Start"
Oct 30 19:24:24.109081 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.109035    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 19:24:24.109081 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.109045    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 19:24:24.110244 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.110232    2583 policy_none.go:44] "Start"
Oct 30 19:24:24.154332 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.154290    2583 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 19:24:24.158357 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.158341    2583 manager.go:341] "Starting Device Plugin manager"
Oct 30 19:24:24.158477 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:24.158379    2583 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 19:24:24.158477 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.158391    2583 server.go:87] "Starting device plugin registration server"
Oct 30 19:24:24.158676 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.158662    2583 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 19:24:24.158734 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.158678    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 19:24:24.158791 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.158751    2583 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 19:24:24.158847 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.158834    2583 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 19:24:24.158847 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.158846    2583 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 19:24:24.159438 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:24.159417    2583 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 19:24:24.159524 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:24.159472    2583 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-34.us-west-2.compute.internal\" not found"
Oct 30 19:24:24.225700 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:24.225600    2583 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-34.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 19:24:24.228276 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:24.225582    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-34.us-west-2.compute.internal.18e3651fd8bebd36  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-34.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-34.us-west-2.compute.internal,},FirstTimestamp:2026-10-30 19:24:24.078359862 +0000 UTC m=+0.485980954,LastTimestamp:2026-10-30 19:24:24.078359862 +0000 UTC m=+0.485980954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-34.us-west-2.compute.internal,}"
Oct 30 19:24:24.242217 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.242189    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 19:24:24.242217 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.242216    2583 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 19:24:24.242368 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.242235    2583 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 19:24:24.242368 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:24.242266    2583 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 19:24:24.259399 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.259367    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:24:24.260428 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.260409    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 19:24:24.260533 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.260442    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 19:24:24.260533 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.260452    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 19:24:24.260533 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.260477    2583 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.274557 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.274529    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-34.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 19:24:24.306784 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.306754    2583 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 19:24:24.306899 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.306803    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-74sqp"
Oct 30 19:24:24.342652 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.342612    2583 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"]
Oct 30 19:24:24.342750 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.342705    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:24:24.343611 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.343596    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 19:24:24.343721 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.343626    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 19:24:24.343721 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.343642    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 19:24:24.345187 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.345174    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:24:24.345344 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.345330    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.345389 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.345360    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:24:24.345938 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.345920    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 19:24:24.346063 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.345946    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 19:24:24.346063 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.345955    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 19:24:24.346063 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.345928    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 19:24:24.346063 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.346022    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 19:24:24.346063 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.346032    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 19:24:24.347348 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.347330    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.347431 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.347363    2583 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:24:24.348190 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.348173    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 19:24:24.348257 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.348206    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 19:24:24.348257 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.348221    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 19:24:24.381692 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:24.381664    2583 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-34.us-west-2.compute.internal\" not found" node="ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.382092 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.382068    2583 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:24:24.384361 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.384334    2583 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:24:24.388535 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:24.388514    2583 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-34.us-west-2.compute.internal\" not found" node="ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.475308 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.475271    2583 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:24:24.477379 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.477334    2583 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:24:24.478315 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.478298    2583 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.478378 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:24.478327    2583 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-34.us-west-2.compute.internal\": node \"ip-10-0-130-34.us-west-2.compute.internal\" not found"
Oct 30 19:24:24.487437 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.487414    2583 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.489064 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.489044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.489123 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.489075    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.489123 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.489092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ceea1ff964927afa3d04bca3afe81300-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"ceea1ff964927afa3d04bca3afe81300\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.553944 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.553914    2583 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:24:24.554109 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.554047    2583 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.589411 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.589377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.589514 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.589420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.589514 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.589442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ceea1ff964927afa3d04bca3afe81300-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"ceea1ff964927afa3d04bca3afe81300\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.589514 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.589502    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ceea1ff964927afa3d04bca3afe81300-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"ceea1ff964927afa3d04bca3afe81300\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.589514 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.589506    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.589635 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.589510    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.626769 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.626737    2583 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:24:24.688067 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.688036    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:24.693291 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:24.693269    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:24:25.017790 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.017758    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 19:24:25.018466 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.017904    2583 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 19:24:25.018466 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.017942    2583 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 19:24:25.018466 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.017967    2583 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 19:24:25.018466 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:25.017988    2583 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a0c1794a904604bf0bf421b952c83549-4b7c0d71fd7f1dce.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-130-34.us-west-2.compute.internal.18e3651fda719d6c\": read tcp 10.0.130.34:46366->18.227.202.105:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-130-34.us-west-2.compute.internal.18e3651fda719d6c  default   5322 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-34.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-34.us-west-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-34.us-west-2.compute.internal,},FirstTimestamp:2026-10-30 19:24:24 +0000 UTC,LastTimestamp:2026-10-30 19:24:24.260455903 +0000 UTC m=+0.668076995,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-34.us-west-2.compute.internal,}"
Oct 30 19:24:25.061904 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.061865    2583 apiserver.go:52] "Watching apiserver"
Oct 30 19:24:25.086943 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.086908    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 19:24:25.309041 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.308958    2583 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 19:24:25.309274 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.309257    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-w4zck","openshift-multus/multus-qzjg5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal","openshift-multus/network-metrics-daemon-hs2pz","openshift-ovn-kubernetes/ovnkube-node-rbq4b","kube-system/global-pull-secret-syncer-xmsrx","kube-system/konnectivity-agent-4nbnr","openshift-dns/node-resolver-7gqc6","openshift-image-registry/node-ca-p8prw","openshift-multus/multus-additional-cni-plugins-7nss2","openshift-network-diagnostics/network-check-target-q9pln","openshift-network-operator/iptables-alerter-5nxn8","kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"]
Oct 30 19:24:25.311081 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.311040    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 19:19:25 +0000 UTC" deadline="2028-06-09 00:02:56.005738847 +0000 UTC"
Oct 30 19:24:25.311081 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.311075    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:25.311220 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.311080    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14092h38m30.694661711s"
Oct 30 19:24:25.312282 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.312260    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:25.313519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.313503    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:25.314724 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.314709    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:25.314820 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:25.314790    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:25.316009 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.315991    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:25.318832 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.318812    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:25.318908 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:25.318872    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:25.320064 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.320048    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:25.321334 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.321321    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:24:25.322719 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.322700    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:24:25.323991 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.323975    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:25.325324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.325310    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:25.325408 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:25.325367    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:25.326561 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.326540    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:24:25.361699 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.361676    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 19:24:25.361820 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.361799    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-ndzf5\""
Oct 30 19:24:25.361820 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.361809    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 19:24:25.361956 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.361848    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 19:24:25.361956 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.361867    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 19:24:25.361956 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.361872    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hthrr\""
Oct 30 19:24:25.361956 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.361884    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 19:24:25.361956 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.361903    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 19:24:25.362414 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.362397    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 19:24:25.362624 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.362608    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 19:24:25.362707 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.362675    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 19:24:25.362781 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.362769    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6ftg5\""
Oct 30 19:24:25.365804 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.365787    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 19:24:25.366104 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.366091    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 19:24:25.366185 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.366173    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 19:24:25.366598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.366585    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 19:24:25.366598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.366590    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 19:24:25.366728 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.366621    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 19:24:25.366728 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.366690    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6nsf6\""
Oct 30 19:24:25.369174 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.369159    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 19:24:25.370369 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.370355    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 19:24:25.370422 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:25.370382    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-s4fj9\""
Oct 30 19:24:26.644946 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.644927    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 19:24:26.650104 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86595af1-257c-481b-8896-7b79fef64d5c-host-slash\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:24:26.650192 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650116    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-bin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.650192 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650140    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-socket-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.650192 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-bin\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.650283 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650208    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52746fc1-d7cc-449f-9f24-bfd4730769d2-serviceca\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:24:26.650283 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.650344 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650281    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cnibin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.650344 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-etc-kubernetes\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.650344 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-kubelet-config\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:26.650344 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650338    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.650455 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650364    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.650455 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5plx\" (UniqueName: \"kubernetes.io/projected/2cac4841-e958-412a-b876-212f39aa120f-kube-api-access-r5plx\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.650455 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx6n9\" (UniqueName: \"kubernetes.io/projected/a4f2cbed-435d-41ed-a904-aab4c3dd4559-kube-api-access-zx6n9\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.650541 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650456    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d5f797e-c46a-47fd-9a80-570a83b355ff-agent-certs\") pod \"konnectivity-agent-4nbnr\" (UID: \"3d5f797e-c46a-47fd-9a80-570a83b355ff\") " pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:26.650541 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650472    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-kubernetes\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.650541 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650485    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-etc-tuned\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.650541 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-conf-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.650541 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-sys-fs\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.650686 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-host\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.650686 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650580    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lxqm\" (UniqueName: \"kubernetes.io/projected/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-kube-api-access-8lxqm\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:26.650686 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cnibin\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.650686 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650638    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj472\" (UniqueName: \"kubernetes.io/projected/375e75d1-5a8d-4595-8e6b-509edbe45c2d-kube-api-access-kj472\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.650686 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650656    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86595af1-257c-481b-8896-7b79fef64d5c-iptables-alerter-script\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:24:26.650686 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650672    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-var-lib-kubelet\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.650872 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650701    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfz4r\" (UniqueName: \"kubernetes.io/projected/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-kube-api-access-xfz4r\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.650872 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650723    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-registration-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.650872 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650740    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:26.650872 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-netns\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.650872 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650777    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-config\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.650872 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-script-lib\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.650872 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650840    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-systemd-units\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.650872 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-log-socket\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650877    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-system-cni-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650891    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-k8s-cni-cncf-io\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650905    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650927    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgdcb\" (UniqueName: \"kubernetes.io/projected/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-kube-api-access-fgdcb\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650964    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-lib-modules\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.650982    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-etc-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651006    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-system-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651024    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cni-binary-copy\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651039    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-socket-dir-parent\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-device-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651069    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pttk\" (UniqueName: \"kubernetes.io/projected/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kube-api-access-2pttk\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651082    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-hosts-file\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:24:26.651100 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651096    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-netd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651141    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651156    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-slash\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651169    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d5f797e-c46a-47fd-9a80-570a83b355ff-konnectivity-ca\") pod \"konnectivity-agent-4nbnr\" (UID: \"3d5f797e-c46a-47fd-9a80-570a83b355ff\") " pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp52t\" (UniqueName: \"kubernetes.io/projected/52746fc1-d7cc-449f-9f24-bfd4730769d2-kube-api-access-qp52t\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651196    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-netns\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-daemon-config\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651260    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-ovn\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651278    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651302    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovn-node-metrics-cert\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651318    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gh5n\" (UniqueName: \"kubernetes.io/projected/86595af1-257c-481b-8896-7b79fef64d5c-kube-api-access-8gh5n\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651335    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-modprobe-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-sys\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.651504 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-dbus\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651398    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-systemd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651420    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-node-log\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysconfig\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651465    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-conf\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651484    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-tmp\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-multus-certs\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651519    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-etc-selinux\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-kubelet\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52746fc1-d7cc-449f-9f24-bfd4730769d2-host\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651663    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-run\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-tmp-dir\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-env-overrides\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-systemd\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651794    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-multus\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.652171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651842    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-kubelet\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.652614 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651876    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-hostroot\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.652614 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651904    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-var-lib-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.652614 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.651930    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.661498 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.661477    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 19:24:26.714946 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.714920    2583 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 19:24:26.715105 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.714986    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6n442"
Oct 30 19:24:26.717904 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.717879    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 19:24:26.717904 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.717883    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 19:24:26.718085 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.717907    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 19:24:26.718085 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.717908    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 19:24:26.718085 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.717931    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 19:24:26.718085 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.717942    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 19:24:26.718085 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.718063    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 19:24:26.718267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.718088    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 19:24:26.718267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.718142    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 19:24:26.718267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.718157    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6prqp\""
Oct 30 19:24:26.718267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.718183    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2d46\""
Oct 30 19:24:26.718267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.718197    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jxzqp\""
Oct 30 19:24:26.718267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.718252    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lzgjh\""
Oct 30 19:24:26.753174 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.753174 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-run\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.753405 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753202    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-tmp-dir\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:24:26.753405 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753224    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-env-overrides\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.753405 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-systemd\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.753405 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753262    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-multus\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.753405 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-kubelet\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.753405 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753279    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-run\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.753405 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753329    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-systemd\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.753405 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753352    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-multus\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.753405 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753371    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-kubelet\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.753405 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753396    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-hostroot\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-var-lib-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753471    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-hostroot\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86595af1-257c-481b-8896-7b79fef64d5c-host-slash\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753508    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86595af1-257c-481b-8896-7b79fef64d5c-host-slash\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-bin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753508    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-var-lib-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-socket-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753548    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-tmp-dir\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753546    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-bin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-bin\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753640    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-bin\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753643    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-socket-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52746fc1-d7cc-449f-9f24-bfd4730769d2-serviceca\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753669    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753709    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cnibin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.753855 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-etc-kubernetes\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753738    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-env-overrides\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753756    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-kubelet-config\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753784    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753743    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cnibin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753788    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-etc-kubernetes\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753846    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753855    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5plx\" (UniqueName: \"kubernetes.io/projected/2cac4841-e958-412a-b876-212f39aa120f-kube-api-access-r5plx\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx6n9\" (UniqueName: \"kubernetes.io/projected/a4f2cbed-435d-41ed-a904-aab4c3dd4559-kube-api-access-zx6n9\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753899    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d5f797e-c46a-47fd-9a80-570a83b355ff-agent-certs\") pod \"konnectivity-agent-4nbnr\" (UID: \"3d5f797e-c46a-47fd-9a80-570a83b355ff\") " pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-kubernetes\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753930    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-etc-tuned\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-conf-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753989    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-kubernetes\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753997    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-sys-fs\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.754746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753947    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754020    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-host\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754044    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lxqm\" (UniqueName: \"kubernetes.io/projected/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-kube-api-access-8lxqm\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754068    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cnibin\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj472\" (UniqueName: \"kubernetes.io/projected/375e75d1-5a8d-4595-8e6b-509edbe45c2d-kube-api-access-kj472\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86595af1-257c-481b-8896-7b79fef64d5c-iptables-alerter-script\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-var-lib-kubelet\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfz4r\" (UniqueName: \"kubernetes.io/projected/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-kube-api-access-xfz4r\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754194    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52746fc1-d7cc-449f-9f24-bfd4730769d2-serviceca\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754204    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-host\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754214    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-registration-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.753899    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-kubelet-config\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754253    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-var-lib-kubelet\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-netns\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754303    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cnibin\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754311    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.755619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754316    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-registration-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754255    2583 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754377    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-conf-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754407    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-netns\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754439    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-sys-fs\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-config\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-script-lib\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-systemd-units\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754601    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-log-socket\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754610    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-systemd-units\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-system-cni-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754638    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-log-socket\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-k8s-cni-cncf-io\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754658    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-system-cni-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754681    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-k8s-cni-cncf-io\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgdcb\" (UniqueName: \"kubernetes.io/projected/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-kube-api-access-fgdcb\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754729    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.756406 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-lib-modules\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754765    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-etc-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754780    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86595af1-257c-481b-8896-7b79fef64d5c-iptables-alerter-script\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-system-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cni-binary-copy\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754862    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-system-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754866    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-socket-dir-parent\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754888    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-device-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754911    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pttk\" (UniqueName: \"kubernetes.io/projected/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kube-api-access-2pttk\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-hosts-file\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754938    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-etc-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754954    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-config\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754976    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-lib-modules\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754981    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-device-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.754958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-netd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755054    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-netd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755098    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-hosts-file\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:24:26.757210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755099    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-script-lib\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-slash\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d5f797e-c46a-47fd-9a80-570a83b355ff-konnectivity-ca\") pod \"konnectivity-agent-4nbnr\" (UID: \"3d5f797e-c46a-47fd-9a80-570a83b355ff\") " pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:26.755214    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755228    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp52t\" (UniqueName: \"kubernetes.io/projected/52746fc1-d7cc-449f-9f24-bfd4730769d2-kube-api-access-qp52t\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755265    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-slash\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:26.755281    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs podName:fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:27.255263039 +0000 UTC m=+2.406724204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs") pod "network-metrics-daemon-hs2pz" (UID: "fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-netns\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755328    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-socket-dir-parent\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:26.755383    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:26.755416    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret podName:36c3af0c-ac42-4a11-9fbd-ebc48700b9d2 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:27.255405459 +0000 UTC m=+2.406866603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret") pod "global-pull-secret-syncer-xmsrx" (UID: "36c3af0c-ac42-4a11-9fbd-ebc48700b9d2") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755436    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-daemon-config\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755460    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-ovn\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.757881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755475    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755505    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-ovn\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755521    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovn-node-metrics-cert\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gh5n\" (UniqueName: \"kubernetes.io/projected/86595af1-257c-481b-8896-7b79fef64d5c-kube-api-access-8gh5n\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755556    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-modprobe-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-sys\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755573    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-dbus\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755669    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-modprobe-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755682    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755710    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-netns\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755728    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cni-binary-copy\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755742    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-systemd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755796    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-dbus\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-node-log\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755875    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-sys\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755917    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysconfig\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.758446 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755944    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-conf\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755966    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysconfig\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756002    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-node-log\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756023    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-systemd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.755969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-tmp\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756227    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-conf\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756251    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-multus-certs\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756348    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-multus-certs\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756403    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-etc-selinux\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-kubelet\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756505    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-kubelet\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52746fc1-d7cc-449f-9f24-bfd4730769d2-host\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756533    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-etc-selinux\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756559    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52746fc1-d7cc-449f-9f24-bfd4730769d2-host\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756582    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.756757    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d5f797e-c46a-47fd-9a80-570a83b355ff-konnectivity-ca\") pod \"konnectivity-agent-4nbnr\" (UID: \"3d5f797e-c46a-47fd-9a80-570a83b355ff\") " pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.757270    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-daemon-config\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.758928 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.757760    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-etc-tuned\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.759396 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.757965    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d5f797e-c46a-47fd-9a80-570a83b355ff-agent-certs\") pod \"konnectivity-agent-4nbnr\" (UID: \"3d5f797e-c46a-47fd-9a80-570a83b355ff\") " pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:26.759396 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.758067    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovn-node-metrics-cert\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.759396 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.758507    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-tmp\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.811231 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:26.811189    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:24:26.811231 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:26.811217    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:24:26.811231 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:26.811228    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6bwv6 for pod openshift-network-diagnostics/network-check-target-q9pln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:26.811506 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:26.811284    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6 podName:81010882-395a-4762-b410-527c640e91ed nodeName:}" failed. No retries permitted until 2026-10-30 19:24:27.311268561 +0000 UTC m=+2.462729718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6bwv6" (UniqueName: "kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6") pod "network-check-target-q9pln" (UID: "81010882-395a-4762-b410-527c640e91ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:26.814460 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.814428    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5plx\" (UniqueName: \"kubernetes.io/projected/2cac4841-e958-412a-b876-212f39aa120f-kube-api-access-r5plx\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.814627 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.814507    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lxqm\" (UniqueName: \"kubernetes.io/projected/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-kube-api-access-8lxqm\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:26.814627 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.814535    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj472\" (UniqueName: \"kubernetes.io/projected/375e75d1-5a8d-4595-8e6b-509edbe45c2d-kube-api-access-kj472\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.814819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.814674    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfz4r\" (UniqueName: \"kubernetes.io/projected/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-kube-api-access-xfz4r\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.814819 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.814680    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgdcb\" (UniqueName: \"kubernetes.io/projected/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-kube-api-access-fgdcb\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:24:26.814931 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.814856    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pttk\" (UniqueName: \"kubernetes.io/projected/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kube-api-access-2pttk\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.815370 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.815320    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx6n9\" (UniqueName: \"kubernetes.io/projected/a4f2cbed-435d-41ed-a904-aab4c3dd4559-kube-api-access-zx6n9\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.815462 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.815424    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp52t\" (UniqueName: \"kubernetes.io/projected/52746fc1-d7cc-449f-9f24-bfd4730769d2-kube-api-access-qp52t\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:24:26.821077 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.821060    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gh5n\" (UniqueName: \"kubernetes.io/projected/86595af1-257c-481b-8896-7b79fef64d5c-kube-api-access-8gh5n\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:24:26.899863 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.899831    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:24:26.918459 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.918424    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qzjg5"
Oct 30 19:24:26.925719 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.925670    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:24:26.952209 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.952179    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:26.954323 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.954298    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:26.973920 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.973892    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:24:26.987075 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.987050    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:24:26.998550 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.998526    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:24:26.999622 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:26.999593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:24:27.047456 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:27.047425    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceea1ff964927afa3d04bca3afe81300.slice/crio-f7798ffabad8992f732acbb9e2ba43f0912c2138a726a6f7121e020da98ef2e3 WatchSource:0}: Error finding container f7798ffabad8992f732acbb9e2ba43f0912c2138a726a6f7121e020da98ef2e3: Status 404 returned error can't find the container with id f7798ffabad8992f732acbb9e2ba43f0912c2138a726a6f7121e020da98ef2e3
Oct 30 19:24:27.047901 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:27.047879    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c68cd55c462db386dbcd1795bbdd95.slice/crio-f0b82694ec3aac43bcc24ebe1a24a36e89559b298ffaf2e97d54915e766ae881 WatchSource:0}: Error finding container f0b82694ec3aac43bcc24ebe1a24a36e89559b298ffaf2e97d54915e766ae881: Status 404 returned error can't find the container with id f0b82694ec3aac43bcc24ebe1a24a36e89559b298ffaf2e97d54915e766ae881
Oct 30 19:24:27.052926 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:27.052904    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:24:27.259816 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:27.259714    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:27.259816 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:27.259754    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:27.259991 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:27.259880    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:27.259991 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:27.259880    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:27.259991 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:27.259943    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret podName:36c3af0c-ac42-4a11-9fbd-ebc48700b9d2 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:28.259928794 +0000 UTC m=+3.411389938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret") pod "global-pull-secret-syncer-xmsrx" (UID: "36c3af0c-ac42-4a11-9fbd-ebc48700b9d2") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:27.259991 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:27.259960    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs podName:fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:28.259952703 +0000 UTC m=+3.411413849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs") pod "network-metrics-daemon-hs2pz" (UID: "fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:27.360545 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:27.360507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:27.361127 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:27.360664    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:24:27.361127 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:27.360685    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:24:27.361127 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:27.360695    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6bwv6 for pod openshift-network-diagnostics/network-check-target-q9pln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:27.361127 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:27.360744    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6 podName:81010882-395a-4762-b410-527c640e91ed nodeName:}" failed. No retries permitted until 2026-10-30 19:24:28.36073047 +0000 UTC m=+3.512191615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bwv6" (UniqueName: "kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6") pod "network-check-target-q9pln" (UID: "81010882-395a-4762-b410-527c640e91ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:27.459064 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:27.459036    2583 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:24:27.503330 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:27.503278    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal" event={"ID":"b2c68cd55c462db386dbcd1795bbdd95","Type":"ContainerStarted","Data":"f0b82694ec3aac43bcc24ebe1a24a36e89559b298ffaf2e97d54915e766ae881"}
Oct 30 19:24:27.504235 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:27.504213    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal" event={"ID":"ceea1ff964927afa3d04bca3afe81300","Type":"ContainerStarted","Data":"f7798ffabad8992f732acbb9e2ba43f0912c2138a726a6f7121e020da98ef2e3"}
Oct 30 19:24:27.691642 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:27.691564    2583 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:24:27.717256 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:27.717204    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 19:19:26 +0000 UTC" deadline="2028-05-06 23:08:47.611176609 +0000 UTC"
Oct 30 19:24:27.717256 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:27.717249    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13299h44m19.893930781s"
Oct 30 19:24:27.772741 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:27.772711    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f2cbed_435d_41ed_a904_aab4c3dd4559.slice/crio-8039ca1d77eb06f2e90d415c2b9d3d2ae0fc10980530d679cd3fd54c2ac13e3c WatchSource:0}: Error finding container 8039ca1d77eb06f2e90d415c2b9d3d2ae0fc10980530d679cd3fd54c2ac13e3c: Status 404 returned error can't find the container with id 8039ca1d77eb06f2e90d415c2b9d3d2ae0fc10980530d679cd3fd54c2ac13e3c
Oct 30 19:24:27.788790 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:27.788764    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86595af1_257c_481b_8896_7b79fef64d5c.slice/crio-2d854e8a3f11d48b9539a131d049f5005297526af3e6001acb08199214e992b0 WatchSource:0}: Error finding container 2d854e8a3f11d48b9539a131d049f5005297526af3e6001acb08199214e992b0: Status 404 returned error can't find the container with id 2d854e8a3f11d48b9539a131d049f5005297526af3e6001acb08199214e992b0
Oct 30 19:24:27.803510 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:27.803484    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7fa839e_ab2c_493b_b53a_79e769aa7d4a.slice/crio-131a3e04a2258e46f03443805d13d12f8b313b8ecbb506053b0483bddfbf5c20 WatchSource:0}: Error finding container 131a3e04a2258e46f03443805d13d12f8b313b8ecbb506053b0483bddfbf5c20: Status 404 returned error can't find the container with id 131a3e04a2258e46f03443805d13d12f8b313b8ecbb506053b0483bddfbf5c20
Oct 30 19:24:27.818174 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:27.818139    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cac4841_e958_412a_b876_212f39aa120f.slice/crio-4580b00a10689bab9b024e1e3c9a8b0f196462c1ab27096c8c0cecf633445160 WatchSource:0}: Error finding container 4580b00a10689bab9b024e1e3c9a8b0f196462c1ab27096c8c0cecf633445160: Status 404 returned error can't find the container with id 4580b00a10689bab9b024e1e3c9a8b0f196462c1ab27096c8c0cecf633445160
Oct 30 19:24:27.825073 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:27.825048    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375e75d1_5a8d_4595_8e6b_509edbe45c2d.slice/crio-1505bdef70cf34df8f028241df12b5d8c4de801d69baea3d53370a5dae36047e WatchSource:0}: Error finding container 1505bdef70cf34df8f028241df12b5d8c4de801d69baea3d53370a5dae36047e: Status 404 returned error can't find the container with id 1505bdef70cf34df8f028241df12b5d8c4de801d69baea3d53370a5dae36047e
Oct 30 19:24:27.825482 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:27.825440    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52746fc1_d7cc_449f_9f24_bfd4730769d2.slice/crio-39439d7ae5b65413793c02a149dc8f0214fe6f657e1670648fde1cd780207426 WatchSource:0}: Error finding container 39439d7ae5b65413793c02a149dc8f0214fe6f657e1670648fde1cd780207426: Status 404 returned error can't find the container with id 39439d7ae5b65413793c02a149dc8f0214fe6f657e1670648fde1cd780207426
Oct 30 19:24:27.860021 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:27.859990    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5f797e_c46a_47fd_9a80_570a83b355ff.slice/crio-6dd0e75a833b25ae936a9b0edf3f4ea5e1dd8c92d95676f7cb578bb7fe8a2514 WatchSource:0}: Error finding container 6dd0e75a833b25ae936a9b0edf3f4ea5e1dd8c92d95676f7cb578bb7fe8a2514: Status 404 returned error can't find the container with id 6dd0e75a833b25ae936a9b0edf3f4ea5e1dd8c92d95676f7cb578bb7fe8a2514
Oct 30 19:24:27.860235 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:27.860217    2583 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:24:27.890245 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:27.890214    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8ca9b6_c7a6_41e2_b335_98f6ba49c4e4.slice/crio-06921b140df4761b1fd8ee437587c6be8552aee4ef261ce2f59141f92b2bc69d WatchSource:0}: Error finding container 06921b140df4761b1fd8ee437587c6be8552aee4ef261ce2f59141f92b2bc69d: Status 404 returned error can't find the container with id 06921b140df4761b1fd8ee437587c6be8552aee4ef261ce2f59141f92b2bc69d
Oct 30 19:24:27.899909 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:24:27.899881    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ba6c78_49c1_47e1_a0bd_4ae3f6784d46.slice/crio-a69ae157d81529b9fb51b76dc641a5c199cd00be6c19e35f75e9238a96927d3b WatchSource:0}: Error finding container a69ae157d81529b9fb51b76dc641a5c199cd00be6c19e35f75e9238a96927d3b: Status 404 returned error can't find the container with id a69ae157d81529b9fb51b76dc641a5c199cd00be6c19e35f75e9238a96927d3b
Oct 30 19:24:28.267794 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.267739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:28.268002 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.267822    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:28.268002 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:28.267964    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:28.268002 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:28.267976    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:28.268172 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:28.268039    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret podName:36c3af0c-ac42-4a11-9fbd-ebc48700b9d2 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:30.268021592 +0000 UTC m=+5.419482742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret") pod "global-pull-secret-syncer-xmsrx" (UID: "36c3af0c-ac42-4a11-9fbd-ebc48700b9d2") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:28.268172 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:28.268088    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs podName:fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:30.268075454 +0000 UTC m=+5.419536600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs") pod "network-metrics-daemon-hs2pz" (UID: "fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:28.368449 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.368410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:28.368943 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:28.368675    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:24:28.368943 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:28.368711    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:24:28.368943 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:28.368724    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6bwv6 for pod openshift-network-diagnostics/network-check-target-q9pln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:28.368943 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:28.368788    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6 podName:81010882-395a-4762-b410-527c640e91ed nodeName:}" failed. No retries permitted until 2026-10-30 19:24:30.368769266 +0000 UTC m=+5.520230413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bwv6" (UniqueName: "kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6") pod "network-check-target-q9pln" (UID: "81010882-395a-4762-b410-527c640e91ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:28.499566 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.499537    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:28.499742 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.499533    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:28.499742 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.499652    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:28.499742 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:28.499661    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:28.499917 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:28.499749    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:28.499917 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:28.499859    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:28.506820 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.506774    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p8prw" event={"ID":"52746fc1-d7cc-449f-9f24-bfd4730769d2","Type":"ContainerStarted","Data":"39439d7ae5b65413793c02a149dc8f0214fe6f657e1670648fde1cd780207426"}
Oct 30 19:24:28.508075 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.508022    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nss2" event={"ID":"375e75d1-5a8d-4595-8e6b-509edbe45c2d","Type":"ContainerStarted","Data":"1505bdef70cf34df8f028241df12b5d8c4de801d69baea3d53370a5dae36047e"}
Oct 30 19:24:28.509790 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.509763    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4zck" event={"ID":"2cac4841-e958-412a-b876-212f39aa120f","Type":"ContainerStarted","Data":"4580b00a10689bab9b024e1e3c9a8b0f196462c1ab27096c8c0cecf633445160"}
Oct 30 19:24:28.514001 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.513977    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qzjg5" event={"ID":"a7fa839e-ab2c-493b-b53a-79e769aa7d4a","Type":"ContainerStarted","Data":"131a3e04a2258e46f03443805d13d12f8b313b8ecbb506053b0483bddfbf5c20"}
Oct 30 19:24:28.515397 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.515372    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b" event={"ID":"a4f2cbed-435d-41ed-a904-aab4c3dd4559","Type":"ContainerStarted","Data":"8039ca1d77eb06f2e90d415c2b9d3d2ae0fc10980530d679cd3fd54c2ac13e3c"}
Oct 30 19:24:28.516619 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.516595    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr" event={"ID":"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46","Type":"ContainerStarted","Data":"a69ae157d81529b9fb51b76dc641a5c199cd00be6c19e35f75e9238a96927d3b"}
Oct 30 19:24:28.517779 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.517754    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7gqc6" event={"ID":"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4","Type":"ContainerStarted","Data":"06921b140df4761b1fd8ee437587c6be8552aee4ef261ce2f59141f92b2bc69d"}
Oct 30 19:24:28.518971 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.518905    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4nbnr" event={"ID":"3d5f797e-c46a-47fd-9a80-570a83b355ff","Type":"ContainerStarted","Data":"6dd0e75a833b25ae936a9b0edf3f4ea5e1dd8c92d95676f7cb578bb7fe8a2514"}
Oct 30 19:24:28.520046 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.520024    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5nxn8" event={"ID":"86595af1-257c-481b-8896-7b79fef64d5c","Type":"ContainerStarted","Data":"2d854e8a3f11d48b9539a131d049f5005297526af3e6001acb08199214e992b0"}
Oct 30 19:24:28.718421 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.718343    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 19:19:26 +0000 UTC" deadline="2028-04-20 02:52:20.911390139 +0000 UTC"
Oct 30 19:24:28.718421 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:28.718391    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12895h27m52.193001321s"
Oct 30 19:24:30.286124 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:30.286081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:30.286124 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:30.286128    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:30.286665 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:30.286310    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:30.286665 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:30.286372    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret podName:36c3af0c-ac42-4a11-9fbd-ebc48700b9d2 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:34.286355628 +0000 UTC m=+9.437816791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret") pod "global-pull-secret-syncer-xmsrx" (UID: "36c3af0c-ac42-4a11-9fbd-ebc48700b9d2") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:30.286793 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:30.286766    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:30.286875 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:30.286841    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs podName:fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:34.286799869 +0000 UTC m=+9.438261020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs") pod "network-metrics-daemon-hs2pz" (UID: "fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:30.387295 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:30.387256    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:30.387526 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:30.387483    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:24:30.387526 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:30.387506    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:24:30.387526 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:30.387518    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6bwv6 for pod openshift-network-diagnostics/network-check-target-q9pln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:30.387696 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:30.387578    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6 podName:81010882-395a-4762-b410-527c640e91ed nodeName:}" failed. No retries permitted until 2026-10-30 19:24:34.387558938 +0000 UTC m=+9.539020098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bwv6" (UniqueName: "kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6") pod "network-check-target-q9pln" (UID: "81010882-395a-4762-b410-527c640e91ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:30.498889 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:30.498859    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:30.499006 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:30.498985    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:30.499070 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:30.499063    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:30.499163 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:30.499145    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:30.499219 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:30.499206    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:30.499296 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:30.499276    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:31.538160 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:31.538083    2583 generic.go:356] "Generic (PLEG): container finished" podID="b2c68cd55c462db386dbcd1795bbdd95" containerID="2ca2584cd930c312d29eb6aadfe13d115295f3069ed4975666f12e6ae4bc85b8" exitCode=0
Oct 30 19:24:31.538741 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:31.538187    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal" event={"ID":"b2c68cd55c462db386dbcd1795bbdd95","Type":"ContainerDied","Data":"2ca2584cd930c312d29eb6aadfe13d115295f3069ed4975666f12e6ae4bc85b8"}
Oct 30 19:24:31.544419 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:31.543930    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal" event={"ID":"ceea1ff964927afa3d04bca3afe81300","Type":"ContainerStarted","Data":"6d2cb23c03eba367dc1101941de1c4c6198c065eba9ed70e968a5a15d4785f6b"}
Oct 30 19:24:31.553587 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:31.552897    2583 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="a97146feeec3e1ab462cff6e0f58a2b7bb055ebb96446799a7e028cc2af8aca0" exitCode=0
Oct 30 19:24:31.553587 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:31.552954    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nss2" event={"ID":"375e75d1-5a8d-4595-8e6b-509edbe45c2d","Type":"ContainerDied","Data":"a97146feeec3e1ab462cff6e0f58a2b7bb055ebb96446799a7e028cc2af8aca0"}
Oct 30 19:24:31.884508 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:31.881187    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal" podStartSLOduration=6.881166569 podStartE2EDuration="6.881166569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:24:31.880183892 +0000 UTC m=+7.031645059" watchObservedRunningTime="2026-10-30 19:24:31.881166569 +0000 UTC m=+7.032627736"
Oct 30 19:24:32.499506 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:32.498681    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:32.499506 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:32.498820    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:32.499506 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:32.499225    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:32.499506 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:32.499330    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:32.499506 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:32.499390    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:32.499506 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:32.499463    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:32.562334 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:32.562250    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal" event={"ID":"b2c68cd55c462db386dbcd1795bbdd95","Type":"ContainerStarted","Data":"ea0aba97a995a6e2f52ce5b01d22ec8692d96322c660c142a7926b965bf00bb5"}
Oct 30 19:24:33.579226 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:33.579189    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4nbnr" event={"ID":"3d5f797e-c46a-47fd-9a80-570a83b355ff","Type":"ContainerStarted","Data":"a22e79cfd73f0e75cb20c9e516aec5ac3b98be408d37799c1c37042bec618c9d"}
Oct 30 19:24:33.689194 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:33.689089    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal" podStartSLOduration=8.68906634 podStartE2EDuration="8.68906634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:24:32.672554411 +0000 UTC m=+7.824015578" watchObservedRunningTime="2026-10-30 19:24:33.68906634 +0000 UTC m=+8.840527508"
Oct 30 19:24:34.320200 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:34.320161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:34.320200 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:34.320207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:34.320410 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:34.320301    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:34.320410 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:34.320357    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret podName:36c3af0c-ac42-4a11-9fbd-ebc48700b9d2 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:42.320339654 +0000 UTC m=+17.471800818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret") pod "global-pull-secret-syncer-xmsrx" (UID: "36c3af0c-ac42-4a11-9fbd-ebc48700b9d2") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:34.320694 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:34.320676    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:34.320759 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:34.320722    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs podName:fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:42.320711261 +0000 UTC m=+17.472172419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs") pod "network-metrics-daemon-hs2pz" (UID: "fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:34.420615 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:34.420559    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:34.420800 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:34.420721    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:24:34.420800 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:34.420742    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:24:34.420800 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:34.420755    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6bwv6 for pod openshift-network-diagnostics/network-check-target-q9pln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:34.420970 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:34.420837    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6 podName:81010882-395a-4762-b410-527c640e91ed nodeName:}" failed. No retries permitted until 2026-10-30 19:24:42.420800004 +0000 UTC m=+17.572261171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bwv6" (UniqueName: "kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6") pod "network-check-target-q9pln" (UID: "81010882-395a-4762-b410-527c640e91ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:34.499290 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:34.499258    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:34.499459 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:34.499402    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:34.499527 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:34.499481    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:34.499762 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:34.499574    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:34.499762 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:34.499630    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:34.499762 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:34.499703    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:34.586740 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:34.586638    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p8prw" event={"ID":"52746fc1-d7cc-449f-9f24-bfd4730769d2","Type":"ContainerStarted","Data":"1d8c92ac2fa31e487eeb2064ac7d0a63c96b4b1ced203ab3a01607669a7483f0"}
Oct 30 19:24:34.590425 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:34.590392    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr" event={"ID":"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46","Type":"ContainerStarted","Data":"b5eface92354bb1e76eb5d1f39bc8533a17a1869d511e08330966d2e3084e6fc"}
Oct 30 19:24:34.695932 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:34.695869    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4nbnr" podStartSLOduration=5.199449264 podStartE2EDuration="9.695847614s" totalImagesPullingTime="4.49639835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:24:33.690299677 +0000 UTC m=+8.841760875" watchObservedRunningTime="2026-10-30 19:24:34.695847614 +0000 UTC m=+9.847308803"
Oct 30 19:24:35.036732 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:35.036521    2583 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:35.037195 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:35.037172    2583 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:35.148381 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:35.148308    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p8prw" podStartSLOduration=4.528899959 podStartE2EDuration="10.148284342s" totalImagesPullingTime="5.619384383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:24:34.696480765 +0000 UTC m=+9.847941932" watchObservedRunningTime="2026-10-30 19:24:35.148284342 +0000 UTC m=+10.299745508"
Oct 30 19:24:35.594396 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:35.594282    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:35.594782 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:35.594653    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:24:36.383045 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:36.382825    2583 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 19:24:36.420922 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:36.420708    2583 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T19:24:36.383038774Z","UUID":"a5dd984d-ecbd-48da-bbdc-702974453555","Handler":null,"Name":"","Endpoint":""}
Oct 30 19:24:36.424181 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:36.422899    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 19:24:36.424181 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:36.422933    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 19:24:36.498729 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:36.498645    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:36.498903 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:36.498775    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:36.498984 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:36.498920    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:36.499047 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:36.499026    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:36.499098 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:36.499073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:36.499173 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:36.499151    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:36.597377 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:36.597341    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qzjg5" event={"ID":"a7fa839e-ab2c-493b-b53a-79e769aa7d4a","Type":"ContainerStarted","Data":"9b175aaa07e90bda395b375b6acc2260be1045b569d137cf1e7aadf81ec57a66"}
Oct 30 19:24:36.600390 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:36.600354    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr" event={"ID":"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46","Type":"ContainerStarted","Data":"0231434cb41296257bcdcd6cc764c4f000498f3803d1bbf4284902e4ffd0ecdb"}
Oct 30 19:24:36.710204 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:36.710129    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-qzjg5" podStartSLOduration=3.7372411469999998 podStartE2EDuration="11.710111024s" totalImagesPullingTime="7.972869877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:24:36.709763523 +0000 UTC m=+11.861224690" watchObservedRunningTime="2026-10-30 19:24:36.710111024 +0000 UTC m=+11.861572192"
Oct 30 19:24:37.604189 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:37.604144    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7gqc6" event={"ID":"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4","Type":"ContainerStarted","Data":"b7b045b4b64f2b4c72e5688ed9921197cd663afb70347275f8d7c48ee5bf9d7f"}
Oct 30 19:24:37.606912 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:37.606872    2583 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="9fd57b6a98dd697dc2478ea8b258b472790adec8b808fa850076cacf976d57eb" exitCode=0
Oct 30 19:24:37.607049 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:37.606963    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nss2" event={"ID":"375e75d1-5a8d-4595-8e6b-509edbe45c2d","Type":"ContainerDied","Data":"9fd57b6a98dd697dc2478ea8b258b472790adec8b808fa850076cacf976d57eb"}
Oct 30 19:24:37.628993 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:37.628956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:37.838495 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:37.838122    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-7gqc6" podStartSLOduration=3.893352011 podStartE2EDuration="12.838100092s" totalImagesPullingTime="8.944748081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:24:37.717077844 +0000 UTC m=+12.868539010" watchObservedRunningTime="2026-10-30 19:24:37.838100092 +0000 UTC m=+12.989561263"
Oct 30 19:24:37.841857 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:37.841798    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:38.499338 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:38.499304    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:38.499517 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:38.499378    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:38.499517 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:38.499493    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:38.499626 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:38.499530    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:38.499674 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:38.499626    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:38.499751 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:38.499731    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:38.610020 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:38.609986    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4zck" event={"ID":"2cac4841-e958-412a-b876-212f39aa120f","Type":"ContainerStarted","Data":"f64a0cd067054f469e71b1238ebf6f8d560d88a95c5808675860df5b770654a8"}
Oct 30 19:24:38.613214 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:38.613020    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr" event={"ID":"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46","Type":"ContainerStarted","Data":"dcc0cc808020fa35a3dd059cdd4c169556f4555c5508b0dc4a19a1325613cd5f"}
Oct 30 19:24:38.615511 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:38.615482    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5nxn8" event={"ID":"86595af1-257c-481b-8896-7b79fef64d5c","Type":"ContainerStarted","Data":"f8f53e48b549fe9c810ae36fba9af07a100175c2c9fd7812e548b229c4ad084b"}
Oct 30 19:24:38.723566 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:38.723502    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w4zck" podStartSLOduration=3.140052624 podStartE2EDuration="13.723485035s" totalImagesPullingTime="10.583432411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:24:38.722905071 +0000 UTC m=+13.874366237" watchObservedRunningTime="2026-10-30 19:24:38.723485035 +0000 UTC m=+13.874946203"
Oct 30 19:24:38.832408 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:38.832356    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5nxn8" podStartSLOduration=5.204031661 podStartE2EDuration="13.832343672s" totalImagesPullingTime="8.628312011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:24:38.831896549 +0000 UTC m=+13.983357740" watchObservedRunningTime="2026-10-30 19:24:38.832343672 +0000 UTC m=+13.983804837"
Oct 30 19:24:38.947457 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:38.947312    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr" podStartSLOduration=4.3083311779999995 podStartE2EDuration="13.947292208s" totalImagesPullingTime="9.63896103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:24:38.947217042 +0000 UTC m=+14.098678209" watchObservedRunningTime="2026-10-30 19:24:38.947292208 +0000 UTC m=+14.098753375"
Oct 30 19:24:39.620025 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:39.619985    2583 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="d6d06e20af3093f79cb9ab8352133624ce1f28cfcf5579baf4a9e74d4fba2c92" exitCode=0
Oct 30 19:24:39.620512 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:39.620090    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nss2" event={"ID":"375e75d1-5a8d-4595-8e6b-509edbe45c2d","Type":"ContainerDied","Data":"d6d06e20af3093f79cb9ab8352133624ce1f28cfcf5579baf4a9e74d4fba2c92"}
Oct 30 19:24:40.499494 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:40.499456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:40.499494 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:40.499479    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:40.499755 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:40.499510    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:40.499755 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:40.499623    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:40.500042 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:40.500004    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:40.500138 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:40.500102    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:41.102243 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:41.102200    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:41.252757 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:41.252721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:41.627088 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:41.627050    2583 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="78c3724fd3b81772f9676e45b27b1bb186e15b36c14973271ecbea3d1a79c2cc" exitCode=0
Oct 30 19:24:41.627263 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:41.627097    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nss2" event={"ID":"375e75d1-5a8d-4595-8e6b-509edbe45c2d","Type":"ContainerDied","Data":"78c3724fd3b81772f9676e45b27b1bb186e15b36c14973271ecbea3d1a79c2cc"}
Oct 30 19:24:42.389925 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:42.389889    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:42.390439 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:42.389931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:42.390439 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:42.390045    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:42.390439 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:42.390045    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:42.390439 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:42.390110    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret podName:36c3af0c-ac42-4a11-9fbd-ebc48700b9d2 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:58.39009177 +0000 UTC m=+33.541552928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret") pod "global-pull-secret-syncer-xmsrx" (UID: "36c3af0c-ac42-4a11-9fbd-ebc48700b9d2") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:42.390439 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:42.390127    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs podName:fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24 nodeName:}" failed. No retries permitted until 2026-10-30 19:24:58.390118149 +0000 UTC m=+33.541579299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs") pod "network-metrics-daemon-hs2pz" (UID: "fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:42.491114 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:42.491075    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:42.491281 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:42.491220    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:24:42.491281 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:42.491237    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:24:42.491281 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:42.491246    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6bwv6 for pod openshift-network-diagnostics/network-check-target-q9pln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:42.491416 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:42.491305    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6 podName:81010882-395a-4762-b410-527c640e91ed nodeName:}" failed. No retries permitted until 2026-10-30 19:24:58.491291809 +0000 UTC m=+33.642752972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bwv6" (UniqueName: "kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6") pod "network-check-target-q9pln" (UID: "81010882-395a-4762-b410-527c640e91ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:42.499570 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:42.499537    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:42.499743 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:42.499646    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:42.499743 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:42.499658    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:42.499871 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:42.499752    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:42.499871 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:42.499818    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:42.499964 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:42.499879    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:43.635679 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:43.635469    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nss2" event={"ID":"375e75d1-5a8d-4595-8e6b-509edbe45c2d","Type":"ContainerStarted","Data":"d950fd12ea8a86c4ef3629ae66a9cd33890404dda67e9a15a7c895574f061290"}
Oct 30 19:24:43.638753 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:43.638728    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b" event={"ID":"a4f2cbed-435d-41ed-a904-aab4c3dd4559","Type":"ContainerStarted","Data":"6e8df642f31288be535a88bae717b4e9287eb7c617a7786493865cbd792d14e7"}
Oct 30 19:24:43.638890 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:43.638794    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b" event={"ID":"a4f2cbed-435d-41ed-a904-aab4c3dd4559","Type":"ContainerStarted","Data":"2061eba1bdaa51b1fd953156b9b0d7ca2cf4c922437f4d1da6aac2c67b832a8a"}
Oct 30 19:24:43.638890 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:43.638844    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b" event={"ID":"a4f2cbed-435d-41ed-a904-aab4c3dd4559","Type":"ContainerStarted","Data":"31a82dc9f1549e89076b64a01f3a585ac243af889f6f1a1fdaa6205a14d6e905"}
Oct 30 19:24:43.638890 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:43.638882    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b" event={"ID":"a4f2cbed-435d-41ed-a904-aab4c3dd4559","Type":"ContainerStarted","Data":"079c96b00548687ed0e01ad6e2b4af329526743068f6fad549457425afb9372e"}
Oct 30 19:24:43.638994 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:43.638908    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b" event={"ID":"a4f2cbed-435d-41ed-a904-aab4c3dd4559","Type":"ContainerStarted","Data":"25c5d9692da76408f57ae717c5db14a0bab7efea3af9f032587397b4c8a0dd5b"}
Oct 30 19:24:43.638994 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:43.638936    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b" event={"ID":"a4f2cbed-435d-41ed-a904-aab4c3dd4559","Type":"ContainerStarted","Data":"7eedda4e30bf9ffff5d8245c1a0c1c7030c8e58789f0eebab9177b0c7e63e5fa"}
Oct 30 19:24:44.499671 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:44.499634    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:44.499848 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:44.499695    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:44.499848 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:44.499708    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:44.499848 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:44.499799    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:44.499965 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:44.499903    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:44.499995 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:44.499965    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:44.643127 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:44.643099    2583 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="d950fd12ea8a86c4ef3629ae66a9cd33890404dda67e9a15a7c895574f061290" exitCode=0
Oct 30 19:24:44.643475 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:44.643138    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nss2" event={"ID":"375e75d1-5a8d-4595-8e6b-509edbe45c2d","Type":"ContainerDied","Data":"d950fd12ea8a86c4ef3629ae66a9cd33890404dda67e9a15a7c895574f061290"}
Oct 30 19:24:44.755336 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:44.755263    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:44.903953 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:44.903924    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:45.068075 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:45.067994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:45.225586 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:45.225556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:45.388947 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:45.388856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:45.549596 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:45.549568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:45.650493 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:45.650419    2583 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="c603097725c522c23d562f2d98fafde29b851b4159923b192b384cf5d565c6d7" exitCode=0
Oct 30 19:24:45.651081 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:45.650498    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nss2" event={"ID":"375e75d1-5a8d-4595-8e6b-509edbe45c2d","Type":"ContainerDied","Data":"c603097725c522c23d562f2d98fafde29b851b4159923b192b384cf5d565c6d7"}
Oct 30 19:24:45.653938 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:45.653915    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b" event={"ID":"a4f2cbed-435d-41ed-a904-aab4c3dd4559","Type":"ContainerStarted","Data":"ca108c7133bda6244066456ec6eecda846e42c91827982fe7cb355b7c395d509"}
Oct 30 19:24:45.705202 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:45.705172    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:45.873119 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:45.873080    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:46.353643 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:46.353602    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:46.499268 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:46.499234    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:46.499432 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:46.499293    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:46.499432 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:46.499305    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:46.499432 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:46.499383    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:46.499558 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:46.499503    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:46.499593 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:46.499572    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:46.537445 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:46.537409    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:46.659735 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:46.659646    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nss2" event={"ID":"375e75d1-5a8d-4595-8e6b-509edbe45c2d","Type":"ContainerStarted","Data":"2b9f1c329c448705a9ac713aa963cccd692ac9c936dc1ae78306895cb153310e"}
Oct 30 19:24:46.784709 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:46.784657    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7nss2" podStartSLOduration=9.462667976 podStartE2EDuration="21.784645264s" totalImagesPullingTime="12.321977288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:24:46.784517568 +0000 UTC m=+21.935978735" watchObservedRunningTime="2026-10-30 19:24:46.784645264 +0000 UTC m=+21.936106429"
Oct 30 19:24:47.063120 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:47.063034    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:47.242430 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:47.242395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:47.524391 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:47.524144    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:47.665555 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:47.665520    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b" event={"ID":"a4f2cbed-435d-41ed-a904-aab4c3dd4559","Type":"ContainerStarted","Data":"2995ab7fd006cb4e097d544e8005bf3f15f33780f883cf8208a826dafc1337af"}
Oct 30 19:24:47.934211 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:47.934102    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b" podStartSLOduration=8.045424503 podStartE2EDuration="22.934087714s" totalImagesPullingTime="14.888663211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:24:47.933589735 +0000 UTC m=+23.085050903" watchObservedRunningTime="2026-10-30 19:24:47.934087714 +0000 UTC m=+23.085548880"
Oct 30 19:24:48.499162 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:48.499122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:48.499382 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:48.499219    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:48.499382 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:48.499233    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:48.499382 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:48.499295    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:48.499475 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:48.499405    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:48.499508 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:48.499484    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:48.614447 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:48.614421    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7gqc6_bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4/dns-node-resolver/0.log"
Oct 30 19:24:48.667992 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:48.667961    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:48.668445 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:48.668051    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:48.668445 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:48.668100    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:48.684321 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:48.684295    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:48.684453 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:48.684404    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:24:48.833480 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:48.833397    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:49.138529 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:49.138437    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:49.342334 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:49.342295    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:49.497653 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:49.497553    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:49.650326 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:49.650293    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:49.820556 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:49.820466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:49.982712 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:49.982684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:50.026699 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:50.026673    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p8prw_52746fc1-d7cc-449f-9f24-bfd4730769d2/node-ca/0.log"
Oct 30 19:24:50.217530 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:50.217448    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:50.374971 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:50.374944    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:50.499031 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:50.498948    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:50.499031 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:50.498979    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:50.499031 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:50.498985    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:50.499208 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:50.499060    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:50.499208 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:50.499154    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:50.499274 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:50.499227    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:51.025955 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:51.025921    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:51.349583 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:51.349498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:51.497388 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:51.497359    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:51.647585 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:51.647500    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:51.816308 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:51.816275    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:51.982584 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:51.982484    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:52.217843 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:52.217782    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:52.499609 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:52.499575    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:52.499775 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:52.499647    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:52.499775 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:52.499675    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:52.499775 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:52.499754    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:52.499925 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:52.499801    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:52.499925 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:52.499884    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:52.585102 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:52.585063    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:53.017649 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:53.017620    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:53.166949 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:53.166920    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:53.422672 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:53.422593    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:53.575794 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:53.575761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:53.725206 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:53.725176    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:53.884403 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:53.884372    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:54.036043 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:54.035962    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:54.185922 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:54.185878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:54.337438 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:54.337359    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:54.499624 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:54.499587    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:54.499624 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:54.499615    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:54.500157 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:54.499709    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:54.500157 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:54.499727    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:54.500157 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:54.499798    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:54.500157 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:54.499877    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:55.094451 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:55.094416    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:55.295294 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:55.295256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:55.438306 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:55.438217    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:55.622494 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:55.622463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:55.825105 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:55.825018    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:56.111556 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:56.111473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:24:56.499165 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:56.499077    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:56.499165 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:56.499118    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:56.499165 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:56.499122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:56.499375 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:56.499200    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:56.499375 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:56.499284    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:56.499375 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:56.499347    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:58.401591 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:58.401535    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:58.401591 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:58.401593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:58.402176 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:58.401683    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:58.402176 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:58.401743    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:58.402176 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:58.401749    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs podName:fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24 nodeName:}" failed. No retries permitted until 2026-10-30 19:25:30.401733233 +0000 UTC m=+65.553194378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs") pod "network-metrics-daemon-hs2pz" (UID: "fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 19:24:58.402176 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:58.401834    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret podName:36c3af0c-ac42-4a11-9fbd-ebc48700b9d2 nodeName:}" failed. No retries permitted until 2026-10-30 19:25:30.401795771 +0000 UTC m=+65.553256916 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret") pod "global-pull-secret-syncer-xmsrx" (UID: "36c3af0c-ac42-4a11-9fbd-ebc48700b9d2") : object "kube-system"/"original-pull-secret" not registered
Oct 30 19:24:58.499349 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:58.499305    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:24:58.499349 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:58.499339    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:58.499560 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:58.499309    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:24:58.499560 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:58.499439    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:24:58.499560 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:58.499490    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:24:58.499560 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:58.499538    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:24:58.502519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:24:58.502495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:24:58.502620 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:58.502608    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 19:24:58.502655 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:58.502625    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 19:24:58.502655 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:58.502634    2583 projected.go:196] Error preparing data for projected volume kube-api-access-6bwv6 for pod openshift-network-diagnostics/network-check-target-q9pln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:24:58.502712 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:24:58.502676    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6 podName:81010882-395a-4762-b410-527c640e91ed nodeName:}" failed. No retries permitted until 2026-10-30 19:25:30.502664059 +0000 UTC m=+65.654125203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6bwv6" (UniqueName: "kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6") pod "network-check-target-q9pln" (UID: "81010882-395a-4762-b410-527c640e91ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 19:25:00.499072 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:00.499027    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:00.499539 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:00.499133    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:00.499539 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:00.499230    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:00.499539 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:00.499238    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:25:00.499539 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:00.499309    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:25:00.499539 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:00.499357    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:25:02.498750 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:02.498695    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:02.499173 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:02.498769    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:02.499173 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:02.498732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:02.499173 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:02.498854    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:25:02.499173 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:02.498932    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:25:02.499173 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:02.499004    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:25:04.498939 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:04.498902    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:04.499335 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:04.498947    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:04.499335 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:04.498993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:04.499335 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:04.499007    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:25:04.499335 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:04.499080    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:25:04.499335 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:04.499166    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:25:04.894613 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:04.894575    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:05.117348 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:05.117317    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:06.339905 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:06.339873    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:06.498763 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:06.498732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:06.498950 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:06.498850    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:06.498950 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:06.498860    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:06.498950 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:06.498859    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:25:06.498950 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:06.498936    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:25:06.499078 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:06.499000    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:25:06.501189 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:06.501165    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:08.498960 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:08.498907    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:08.498960 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:08.498963    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:08.499397 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:08.498938    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:08.499397 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:08.499027    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:25:08.499397 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:08.499102    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:25:08.499397 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:08.499164    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:25:09.529939 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:09.529895    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:09.735648 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:09.735616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:10.154536 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:10.154506    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:10.307923 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:10.307888    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:10.499687 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:10.499594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:10.499687 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:10.499617    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:10.499909 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:10.499713    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:25:10.499909 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:10.499724    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:10.499909 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:10.499799    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:25:10.499909 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:10.499883    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:25:10.979326 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:10.979130    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xmsrx"]
Oct 30 19:25:10.979854 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:10.979429    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:10.979854 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:10.979551    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:25:10.982244 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:10.982218    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q9pln"]
Oct 30 19:25:10.982518 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:10.982499    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:10.982747 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:10.982721    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:25:10.984262 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:10.984234    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hs2pz"]
Oct 30 19:25:10.984417 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:10.984402    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:10.984568 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:10.984546    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:25:12.499363 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:12.499323    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:12.499363 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:12.499337    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:12.499981 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:12.499460    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:25:12.499981 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:12.499501    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:12.499981 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:12.499574    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:25:12.499981 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:12.499637    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:25:13.942935 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:13.942898    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:14.098756 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:14.098718    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:14.268636 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:14.268541    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:14.435122 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:14.435084    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:14.499449 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:14.499411    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:14.499632 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:14.499411    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:14.499632 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:14.499540    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q9pln" podUID="81010882-395a-4762-b410-527c640e91ed"
Oct 30 19:25:14.499632 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:14.499411    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:14.499789 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:14.499597    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xmsrx" podUID="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2"
Oct 30 19:25:14.499789 ip-10-0-130-34 kubenswrapper[2583]: E1030 19:25:14.499697    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hs2pz" podUID="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24"
Oct 30 19:25:15.628485 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.628454    2583 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeReady"
Oct 30 19:25:15.628889 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.628567    2583 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 19:25:15.729946 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.729912    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-72djl"]
Oct 30 19:25:15.743388 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.743320    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-whdq6"]
Oct 30 19:25:15.743518 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.743442    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:15.757557 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.757532    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.762669 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.762637    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x4n4k"]
Oct 30 19:25:15.783743 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.783711    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:15.793540 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.793517    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 19:25:15.793656 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.793594    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 19:25:15.793999 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.793986    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 19:25:15.794208 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.794192    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-9th84\""
Oct 30 19:25:15.810683 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.810657    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-72djl"]
Oct 30 19:25:15.813208 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.813184    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whdq6"]
Oct 30 19:25:15.823696 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.823664    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dstt\" (UniqueName: \"kubernetes.io/projected/8c8a6569-544e-4574-a9f2-0b5396a40984-kube-api-access-4dstt\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.823838 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.823701    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c8a6569-544e-4574-a9f2-0b5396a40984-metrics-tls\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.823838 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.823722    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-cert\") pod \"ingress-canary-72djl\" (UID: \"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526\") " pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:15.823838 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.823738    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c8a6569-544e-4574-a9f2-0b5396a40984-config-volume\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.823838 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.823823    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mr4s\" (UniqueName: \"kubernetes.io/projected/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-kube-api-access-8mr4s\") pod \"ingress-canary-72djl\" (UID: \"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526\") " pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:15.824008 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.823906    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c8a6569-544e-4574-a9f2-0b5396a40984-tmp-dir\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.875471 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.875437    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x4n4k"]
Oct 30 19:25:15.893872 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.893839    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 19:25:15.894122 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.893935    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 19:25:15.894122 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.893948    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 19:25:15.894122 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.893947    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 19:25:15.894314 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.894301    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 19:25:15.894369 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.894358    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8x78l\""
Oct 30 19:25:15.894422 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.894366    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f29wx\""
Oct 30 19:25:15.894778 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.894756    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 19:25:15.924455 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.924420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dstt\" (UniqueName: \"kubernetes.io/projected/8c8a6569-544e-4574-a9f2-0b5396a40984-kube-api-access-4dstt\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.924455 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.924457    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:15.924664 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.924483    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c8a6569-544e-4574-a9f2-0b5396a40984-metrics-tls\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.924664 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.924551    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-cert\") pod \"ingress-canary-72djl\" (UID: \"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526\") " pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:15.924764 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.924693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-data-volume\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:15.924764 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.924723    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c8a6569-544e-4574-a9f2-0b5396a40984-config-volume\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.924764 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.924748    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-crio-socket\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:15.924926 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.924876    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mr4s\" (UniqueName: \"kubernetes.io/projected/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-kube-api-access-8mr4s\") pod \"ingress-canary-72djl\" (UID: \"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526\") " pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:15.924971 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.924925    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkjjx\" (UniqueName: \"kubernetes.io/projected/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-api-access-rkjjx\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:15.924971 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.924963    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c8a6569-544e-4574-a9f2-0b5396a40984-tmp-dir\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.925053 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.924991    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:15.925296 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.925274    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c8a6569-544e-4574-a9f2-0b5396a40984-tmp-dir\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.925371 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.925348    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c8a6569-544e-4574-a9f2-0b5396a40984-config-volume\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.928617 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.928589    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c8a6569-544e-4574-a9f2-0b5396a40984-metrics-tls\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.928718 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.928626    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-cert\") pod \"ingress-canary-72djl\" (UID: \"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526\") " pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:15.982841 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.982791    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dstt\" (UniqueName: \"kubernetes.io/projected/8c8a6569-544e-4574-a9f2-0b5396a40984-kube-api-access-4dstt\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:15.983015 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:15.982965    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mr4s\" (UniqueName: \"kubernetes.io/projected/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-kube-api-access-8mr4s\") pod \"ingress-canary-72djl\" (UID: \"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526\") " pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:16.026372 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.026288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-data-volume\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:16.026372 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.026324    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-crio-socket\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:16.026372 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.026346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkjjx\" (UniqueName: \"kubernetes.io/projected/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-api-access-rkjjx\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:16.026372 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.026364    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:16.026749 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.026438    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:16.026749 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.026527    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-crio-socket\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:16.026749 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.026627    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-data-volume\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:16.027034 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.027010    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:16.028934 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.028915    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:16.066365 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.066318    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:16.085073 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.085041    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkjjx\" (UniqueName: \"kubernetes.io/projected/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-api-access-rkjjx\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:16.108039 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.108003    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:16.111952 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.111919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:16.151571 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.151538    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:16.305113 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.305075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:16.499628 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.499595    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:16.499798 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.499653    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:16.499798 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.499746    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:16.517293 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.517268    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-72djl"]
Oct 30 19:25:16.517909 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.517877    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whdq6"]
Oct 30 19:25:16.550005 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.549970    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 19:25:16.550005 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.549970    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 19:25:16.550947 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.550917    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4g88n\""
Oct 30 19:25:16.550947 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.550931    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-vwkbz\""
Oct 30 19:25:16.550947 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.550941    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 19:25:16.551110 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.550931    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 19:25:16.551110 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.550976    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9jbqb\""
Oct 30 19:25:16.567691 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.567616    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x4n4k"]
Oct 30 19:25:16.574323 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:16.574300    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b5e381_31e7_4ca3_a2f3_c0f59d34bd41.slice/crio-3420a6c033bb5ef447aba3ebdfa6d1c0d8e9aa128be3ec2da9c93073485347c2 WatchSource:0}: Error finding container 3420a6c033bb5ef447aba3ebdfa6d1c0d8e9aa128be3ec2da9c93073485347c2: Status 404 returned error can't find the container with id 3420a6c033bb5ef447aba3ebdfa6d1c0d8e9aa128be3ec2da9c93073485347c2
Oct 30 19:25:16.612642 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.612612    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:16.727993 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.727961    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4n4k" event={"ID":"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41","Type":"ContainerStarted","Data":"343d10ad574bd7de23d2bf88863778bbfbb5dac47e3c86ea7a6c4205c57da7bc"}
Oct 30 19:25:16.728417 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.728064    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4n4k" event={"ID":"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41","Type":"ContainerStarted","Data":"3420a6c033bb5ef447aba3ebdfa6d1c0d8e9aa128be3ec2da9c93073485347c2"}
Oct 30 19:25:16.729155 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.729121    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whdq6" event={"ID":"8c8a6569-544e-4574-a9f2-0b5396a40984","Type":"ContainerStarted","Data":"8ca97d579ff24a1a53a1d57327e8dec74ee34d0b88000382c38598ab25bdf8eb"}
Oct 30 19:25:16.730178 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.730149    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-72djl" event={"ID":"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526","Type":"ContainerStarted","Data":"eec173871e025d96dcca044b8c81c7ea13f88767e45c84536a413a8200904cb6"}
Oct 30 19:25:16.788402 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.788366    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:16.818799 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.818721    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-c49cd799b-652dx"]
Oct 30 19:25:16.829229 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.829204    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:16.878445 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.878411    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c49cd799b-652dx"]
Oct 30 19:25:16.879503 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.879474    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 19:25:16.879726 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.879508    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 19:25:16.879726 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.879574    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 19:25:16.879726 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.879576    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 19:25:16.879726 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.879687    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 19:25:16.879726 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.879720    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 19:25:16.880277 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.879761    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w9lxj\""
Oct 30 19:25:16.880277 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.879822    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 19:25:16.927257 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.927225    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 19:25:16.933239 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.933209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-oauth-config\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:16.933341 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.933242    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/967c1b48-0633-4580-8075-ea41321e866b-tmp\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:16.933341 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.933259    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbxc8\" (UniqueName: \"kubernetes.io/projected/967c1b48-0633-4580-8075-ea41321e866b-kube-api-access-nbxc8\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:16.933341 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.933286    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-trusted-ca-bundle\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:16.933341 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.933302    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-console-config\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:16.933456 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.933435    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-oauth-serving-cert\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:16.933490 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.933463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-serving-cert\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:16.933490 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.933481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-service-ca\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:16.949709 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:16.949676    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:17.034359 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.034323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-oauth-serving-cert\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.034543 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.034366    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-serving-cert\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.034543 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.034388    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-service-ca\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.034543 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.034441    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-oauth-config\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.034543 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.034462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/967c1b48-0633-4580-8075-ea41321e866b-tmp\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.034543 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.034487    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbxc8\" (UniqueName: \"kubernetes.io/projected/967c1b48-0633-4580-8075-ea41321e866b-kube-api-access-nbxc8\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.034867 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.034838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-trusted-ca-bundle\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.035005 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.034875    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-console-config\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.035005 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.034884    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/967c1b48-0633-4580-8075-ea41321e866b-tmp\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.035239 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.035200    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-oauth-serving-cert\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.035497 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.035472    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-service-ca\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.035550 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.035520    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-console-config\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.035839 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.035796    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-trusted-ca-bundle\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.037210 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.037186    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-oauth-config\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.037306 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.037186    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-serving-cert\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.093375 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.093298    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbxc8\" (UniqueName: \"kubernetes.io/projected/967c1b48-0633-4580-8075-ea41321e866b-kube-api-access-nbxc8\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.145984 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.145944    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:17.547350 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.547319    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c49cd799b-652dx"]
Oct 30 19:25:17.554709 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:17.554680    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967c1b48_0633_4580_8075_ea41321e866b.slice/crio-ac018828065099ab71a4aa616c89233e5b18ac7e177abefec61071267058dc9e WatchSource:0}: Error finding container ac018828065099ab71a4aa616c89233e5b18ac7e177abefec61071267058dc9e: Status 404 returned error can't find the container with id ac018828065099ab71a4aa616c89233e5b18ac7e177abefec61071267058dc9e
Oct 30 19:25:17.740257 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:17.740217    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c49cd799b-652dx" event={"ID":"967c1b48-0633-4580-8075-ea41321e866b","Type":"ContainerStarted","Data":"ac018828065099ab71a4aa616c89233e5b18ac7e177abefec61071267058dc9e"}
Oct 30 19:25:18.747747 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:18.747659    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4n4k" event={"ID":"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41","Type":"ContainerStarted","Data":"041f497086cd2018987f19de2528c5a472d8b8d20baa2678cd395a951d696da4"}
Oct 30 19:25:19.544181 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:19.544145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:19.747952 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:19.747862    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:19.754760 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:19.753719    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whdq6" event={"ID":"8c8a6569-544e-4574-a9f2-0b5396a40984","Type":"ContainerStarted","Data":"85ea9121b4ab5e7111ec12e16e02c1882589b05aecc8ce669c8060ae2b64d9ff"}
Oct 30 19:25:19.754760 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:19.753785    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whdq6" event={"ID":"8c8a6569-544e-4574-a9f2-0b5396a40984","Type":"ContainerStarted","Data":"407980e3746805c83ae58a4af829a9f0c4e9801720049ce529aa0c742cf65436"}
Oct 30 19:25:19.754760 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:19.754686    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:19.902630 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:19.902395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:20.050624 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:20.050584    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:20.219745 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:20.219653    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:20.453862 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:20.453832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:20.690889 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:20.690862    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:20.759435 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:20.759345    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4n4k" event={"ID":"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41","Type":"ContainerStarted","Data":"757b282dcd6f06435f1a7c1d3cb0a5103aa18dc5dd43448ae65fc5f2a63e84f9"}
Oct 30 19:25:20.764606 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:20.764556    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-72djl" event={"ID":"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526","Type":"ContainerStarted","Data":"f101dbd79ca67740c2dd4d0fa642d7a61e860ebea5afcfd55dcf013c3a230746"}
Oct 30 19:25:20.826721 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:20.826665    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-whdq6" podStartSLOduration=3.0528080380000002 podStartE2EDuration="5.826648901s" totalImagesPullingTime="2.773840863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:19.872122473 +0000 UTC m=+55.023583655" watchObservedRunningTime="2026-10-30 19:25:20.826648901 +0000 UTC m=+55.978110500"
Oct 30 19:25:20.833362 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:20.833322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:20.946243 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:20.946182    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x4n4k" podStartSLOduration=2.078143272 podStartE2EDuration="5.946156753s" totalImagesPullingTime="3.868013481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:25:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:20.945896066 +0000 UTC m=+56.097357232" watchObservedRunningTime="2026-10-30 19:25:20.946156753 +0000 UTC m=+56.097617922"
Oct 30 19:25:20.992778 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:20.992743    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:21.042183 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.042093    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"]
Oct 30 19:25:21.048027 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.047998    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.063540 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.063473    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-72djl" podStartSLOduration=2.13798498 podStartE2EDuration="6.063453368s" totalImagesPullingTime="3.925468388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:21.063218969 +0000 UTC m=+56.214680155" watchObservedRunningTime="2026-10-30 19:25:21.063453368 +0000 UTC m=+56.214914535"
Oct 30 19:25:21.101952 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.101901    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 19:25:21.102228 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.102197    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 19:25:21.102228 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.102202    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 19:25:21.102419 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.102275    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 19:25:21.102419 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.102296    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fvq7j\""
Oct 30 19:25:21.102419 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.102352    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 19:25:21.103143 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.103118    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"]
Oct 30 19:25:21.151887 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.151846    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:21.168385 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.168354    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"]
Oct 30 19:25:21.170362 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.170339    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.170546 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.170521    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.170657 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.170631    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm7qf\" (UniqueName: \"kubernetes.io/projected/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-kube-api-access-jm7qf\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.170818 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.170682    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.170818 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.170778    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.194091 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.194068    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n47m6"]
Oct 30 19:25:21.197074 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.197055    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.220924 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.220900    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 19:25:21.221038 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.220970    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8b6ps\""
Oct 30 19:25:21.221097 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.221085    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 19:25:21.221418 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.221405    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 19:25:21.235351 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.235326    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"]
Oct 30 19:25:21.251644 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.251619    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 19:25:21.251794 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.251721    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 19:25:21.251861 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.251793    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8mnv5\""
Oct 30 19:25:21.272097 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm7qf\" (UniqueName: \"kubernetes.io/projected/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-kube-api-access-jm7qf\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.272257 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.272257 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272135    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/586f9624-2168-4588-a01f-9cc483699682-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.272257 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272166    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-sys\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.272257 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272188    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7vnf\" (UniqueName: \"kubernetes.io/projected/063cbdd6-3453-4a82-9532-6a846ad94f0e-kube-api-access-m7vnf\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.272257 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272221    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.272500 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.272500 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-wtmp\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.272500 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-tls\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.272500 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272470    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.272692 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272539    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-metrics-client-ca\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.272692 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272581    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-root\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.272692 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272656    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-textfile\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.272692 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272686    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.272869 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272766    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.272869 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272822    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7vgf\" (UniqueName: \"kubernetes.io/projected/586f9624-2168-4588-a01f-9cc483699682-kube-api-access-n7vgf\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.272949 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272911    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.272993 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272958    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.273024 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.272992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.273945 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.273915    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.274886 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.274864    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.275489 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.275472    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.308854 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.308793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:21.318544 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.318513    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 19:25:21.335080 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.335052    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm7qf\" (UniqueName: \"kubernetes.io/projected/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-kube-api-access-jm7qf\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.362751 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.362722    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:21.374285 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.374379 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7vgf\" (UniqueName: \"kubernetes.io/projected/586f9624-2168-4588-a01f-9cc483699682-kube-api-access-n7vgf\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.374449 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374428    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.374514 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.374565 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/586f9624-2168-4588-a01f-9cc483699682-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.374613 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-sys\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.374613 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7vnf\" (UniqueName: \"kubernetes.io/projected/063cbdd6-3453-4a82-9532-6a846ad94f0e-kube-api-access-m7vnf\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.374705 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374621    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.374705 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-wtmp\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.374705 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374680    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-tls\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.374705 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374685    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-sys\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.374982 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.374982 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374765    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-metrics-client-ca\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.374982 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374826    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-root\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.374982 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-textfile\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.374982 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.374889    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.375222 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.375035    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-wtmp\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.375222 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.375197    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.375463 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.375387    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-root\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.375546 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.375499    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/586f9624-2168-4588-a01f-9cc483699682-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.375546 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.375533    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.375914 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.375874    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.376133 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.376110    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-metrics-client-ca\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.376384 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.376360    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-textfile\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.377148 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.377128    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.377536 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.377520    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.378293 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.378263    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.378366 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.378297    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-tls\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.433590 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.433558    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7vnf\" (UniqueName: \"kubernetes.io/projected/063cbdd6-3453-4a82-9532-6a846ad94f0e-kube-api-access-m7vnf\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.434065 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.434040    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7vgf\" (UniqueName: \"kubernetes.io/projected/586f9624-2168-4588-a01f-9cc483699682-kube-api-access-n7vgf\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.463637 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.463602    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:21.483617 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.483578    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:21.522948 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.522909    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:21.730882 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.730778    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:21.770507 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.770475    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c49cd799b-652dx" event={"ID":"967c1b48-0633-4580-8075-ea41321e866b","Type":"ContainerStarted","Data":"c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4"}
Oct 30 19:25:21.771769 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.771734    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n47m6" event={"ID":"063cbdd6-3453-4a82-9532-6a846ad94f0e","Type":"ContainerStarted","Data":"46436299dc90e3270dfe9b2afc376efc56db5607e6027d6121e8e7994d44838f"}
Oct 30 19:25:21.782470 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.782441    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"]
Oct 30 19:25:21.789117 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:21.789073    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e772a6_140b_4d72_873d_ac43b9b2f0a3.slice/crio-50e1279c5e004ce798d73a50162d234169f4b3032efa0ada158564816f77b965 WatchSource:0}: Error finding container 50e1279c5e004ce798d73a50162d234169f4b3032efa0ada158564816f77b965: Status 404 returned error can't find the container with id 50e1279c5e004ce798d73a50162d234169f4b3032efa0ada158564816f77b965
Oct 30 19:25:21.852885 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.852840    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"]
Oct 30 19:25:21.866042 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:21.866014    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586f9624_2168_4588_a01f_9cc483699682.slice/crio-30f0faf425e8933a9257bc2a808d2cb8d79b0407de61f77b0f128a8236be7f54 WatchSource:0}: Error finding container 30f0faf425e8933a9257bc2a808d2cb8d79b0407de61f77b0f128a8236be7f54: Status 404 returned error can't find the container with id 30f0faf425e8933a9257bc2a808d2cb8d79b0407de61f77b0f128a8236be7f54
Oct 30 19:25:21.888328 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:21.888284    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-c49cd799b-652dx" podStartSLOduration=2.266669326 podStartE2EDuration="5.888270035s" totalImagesPullingTime="3.621600709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:21.88762105 +0000 UTC m=+57.039082217" watchObservedRunningTime="2026-10-30 19:25:21.888270035 +0000 UTC m=+57.039731202"
Oct 30 19:25:22.356613 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:22.356574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:22.557546 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:22.557497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:22.781077 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:22.780980    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv" event={"ID":"c4e772a6-140b-4d72-873d-ac43b9b2f0a3","Type":"ContainerStarted","Data":"387adff11457efabe7b6e89aab8f1b14eea477842ceef82aac6c045f2c6b9c76"}
Oct 30 19:25:22.781077 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:22.781054    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv" event={"ID":"c4e772a6-140b-4d72-873d-ac43b9b2f0a3","Type":"ContainerStarted","Data":"b7b3fea48e217c250df86b559d67a6003dc103cf16c85ca2b4dc1c599ed8f17e"}
Oct 30 19:25:22.781587 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:22.781085    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv" event={"ID":"c4e772a6-140b-4d72-873d-ac43b9b2f0a3","Type":"ContainerStarted","Data":"50e1279c5e004ce798d73a50162d234169f4b3032efa0ada158564816f77b965"}
Oct 30 19:25:22.782417 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:22.782391    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg" event={"ID":"586f9624-2168-4588-a01f-9cc483699682","Type":"ContainerStarted","Data":"30f0faf425e8933a9257bc2a808d2cb8d79b0407de61f77b0f128a8236be7f54"}
Oct 30 19:25:23.254712 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.254674    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:23.298630 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.298591    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:25:23.302202 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.302165    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.359184 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.359092    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 19:25:23.359634 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.359615    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 19:25:23.359746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.359644    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 19:25:23.359746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.359663    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 19:25:23.359746 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.359663    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 19:25:23.359922 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.359882    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 19:25:23.359922 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.359893    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 19:25:23.363238 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.363216    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 19:25:23.369187 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.369049    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:25:23.395086 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395047    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-out\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395095    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395123    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395151    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395189    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-web-config\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395243    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395313    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395340    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qph6d\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-kube-api-access-qph6d\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395417    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395445    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.395519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.395489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.451207 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.451154    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 19:25:23.457687 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.457657    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-stvjk\""
Oct 30 19:25:23.496248 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496427 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496427 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496293    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496427 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496318    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qph6d\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-kube-api-access-qph6d\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496427 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496345    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496427 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496427 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496720 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496445    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496720 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496468    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-out\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496720 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496493    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496720 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496720 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.496720 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-web-config\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.497196 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.496718    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.497541 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.497515    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.498491 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.498154    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.501889 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.501670    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.502663 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.502286    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-out\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.503208 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.503184    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.505231 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.505207    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.505891 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.505869    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.506094 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.506067    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-web-config\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.506233 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.506217    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.506827 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.506783    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.507512 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.507473    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.562042 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.562015    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qph6d\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-kube-api-access-qph6d\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.631897 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.631787    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:23.787625 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.787593    2583 generic.go:356] "Generic (PLEG): container finished" podID="063cbdd6-3453-4a82-9532-6a846ad94f0e" containerID="0bfbc2da463697a1c83e34332965981bb066bae4adbfba41f8987f421200716c" exitCode=0
Oct 30 19:25:23.788076 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.787715    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n47m6" event={"ID":"063cbdd6-3453-4a82-9532-6a846ad94f0e","Type":"ContainerDied","Data":"0bfbc2da463697a1c83e34332965981bb066bae4adbfba41f8987f421200716c"}
Oct 30 19:25:23.790260 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.790232    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv" event={"ID":"c4e772a6-140b-4d72-873d-ac43b9b2f0a3","Type":"ContainerStarted","Data":"5670f20bf14c4c4af777033be656f799bc30e4cd27923757729b07f16b6bea93"}
Oct 30 19:25:23.792410 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:23.792382    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg" event={"ID":"586f9624-2168-4588-a01f-9cc483699682","Type":"ContainerStarted","Data":"e250f29538a2d17e336d9edea7deba60438b107ba29d3bf2b28a83e2871e62e4"}
Oct 30 19:25:24.020265 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.020152    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv" podStartSLOduration=1.420060401 podStartE2EDuration="3.020136525s" totalImagesPullingTime="1.600076124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:24.019875764 +0000 UTC m=+59.171336944" watchObservedRunningTime="2026-10-30 19:25:24.020136525 +0000 UTC m=+59.171597687"
Oct 30 19:25:24.079137 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.079107    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:25:24.085655 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:24.085629    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab4c499_e0ea_4f67_b673_c2f8957d06ac.slice/crio-539c17aa278d6e8e3ffbc588b0d4339a55f2197d41a9ce23cd192f2529b493c2 WatchSource:0}: Error finding container 539c17aa278d6e8e3ffbc588b0d4339a55f2197d41a9ce23cd192f2529b493c2: Status 404 returned error can't find the container with id 539c17aa278d6e8e3ffbc588b0d4339a55f2197d41a9ce23cd192f2529b493c2
Oct 30 19:25:24.679027 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.678993    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"]
Oct 30 19:25:24.682574 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.682553    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.733978 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.733927    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 19:25:24.733978 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.733927    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 19:25:24.733978 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.733942    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 19:25:24.734230 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.733956    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9rgsb2985p4kr\""
Oct 30 19:25:24.734230 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.734027    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 19:25:24.734230 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.734046    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qkj5g\""
Oct 30 19:25:24.734230 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.734056    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 19:25:24.782263 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.782227    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"]
Oct 30 19:25:24.800759 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.800718    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerStarted","Data":"539c17aa278d6e8e3ffbc588b0d4339a55f2197d41a9ce23cd192f2529b493c2"}
Oct 30 19:25:24.802912 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.802882    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg" event={"ID":"586f9624-2168-4588-a01f-9cc483699682","Type":"ContainerStarted","Data":"7863498e443ba4d67cb10421a69a734539dadd349871ae1e3e7905641becbbe9"}
Oct 30 19:25:24.803038 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.802945    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg" event={"ID":"586f9624-2168-4588-a01f-9cc483699682","Type":"ContainerStarted","Data":"6bbfa31395503e8823a0ef589d84922c6259815f92f892f59836159974699ab4"}
Oct 30 19:25:24.804919 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.804889    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n47m6" event={"ID":"063cbdd6-3453-4a82-9532-6a846ad94f0e","Type":"ContainerStarted","Data":"685362977f61005e73bcf678b82893a905a7a07f4b4cd9d25d3aafda9633cd0f"}
Oct 30 19:25:24.805013 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.804945    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n47m6" event={"ID":"063cbdd6-3453-4a82-9532-6a846ad94f0e","Type":"ContainerStarted","Data":"e0685b2dc1432921c17dbff956b30a5c12e09aae98b289359d686119f5dff7f3"}
Oct 30 19:25:24.808290 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.808269    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d78689c3-56b1-481c-9ef7-bf81b9a9679e-metrics-client-ca\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.808367 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.808305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.808411 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.808396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-grpc-tls\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.808539 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.808520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d78689c3-56b1-481c-9ef7-bf81b9a9679e-tmp\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.808585 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.808569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-tls\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.808673 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.808651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.808763 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.808679    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.808763 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.808703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.808763 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.808742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brbm2\" (UniqueName: \"kubernetes.io/projected/d78689c3-56b1-481c-9ef7-bf81b9a9679e-kube-api-access-brbm2\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.909704 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.909661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d78689c3-56b1-481c-9ef7-bf81b9a9679e-tmp\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.909891 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.909759    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-tls\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.909891 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.909783    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.909891 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.909842    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.909891 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.909872    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.910095 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.909899    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brbm2\" (UniqueName: \"kubernetes.io/projected/d78689c3-56b1-481c-9ef7-bf81b9a9679e-kube-api-access-brbm2\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.910095 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.909988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d78689c3-56b1-481c-9ef7-bf81b9a9679e-metrics-client-ca\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.910095 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.910015    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.910258 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.910111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-grpc-tls\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.910258 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.910148    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d78689c3-56b1-481c-9ef7-bf81b9a9679e-tmp\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.911157 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.911133    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d78689c3-56b1-481c-9ef7-bf81b9a9679e-metrics-client-ca\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.913034 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.913008    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.913250 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.913228    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-tls\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.913403 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.913380    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-grpc-tls\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.913532 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.913510    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.913584 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.913537    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.913584 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.913553    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:24.922621 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.922578    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n47m6" podStartSLOduration=2.487521424 podStartE2EDuration="3.922561867s" totalImagesPullingTime="1.347938868s" totalInitContainerRuntime="87.101575ms" isStatefulPod=true podCreationTimestamp="2026-10-30 19:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:24.922170541 +0000 UTC m=+60.073631708" watchObservedRunningTime="2026-10-30 19:25:24.922561867 +0000 UTC m=+60.074023034"
Oct 30 19:25:24.934538 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.934474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:24.970171 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:24.970129    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brbm2\" (UniqueName: \"kubernetes.io/projected/d78689c3-56b1-481c-9ef7-bf81b9a9679e-kube-api-access-brbm2\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:25.000267 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.000231    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:25.038347 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.038292    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg" podStartSLOduration=2.205505913 podStartE2EDuration="4.038278885s" totalImagesPullingTime="1.832772972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:25.038089506 +0000 UTC m=+60.189550674" watchObservedRunningTime="2026-10-30 19:25:25.038278885 +0000 UTC m=+60.189740050"
Oct 30 19:25:25.092480 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.092444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:25.376083 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.376052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:25.447251 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.447219    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"]
Oct 30 19:25:25.453027 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:25.452999    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd78689c3_56b1_481c_9ef7_bf81b9a9679e.slice/crio-8834f4b1de471ce7857364be8abbc3374fd6633b0dcc858b9521138903fd6967 WatchSource:0}: Error finding container 8834f4b1de471ce7857364be8abbc3374fd6633b0dcc858b9521138903fd6967: Status 404 returned error can't find the container with id 8834f4b1de471ce7857364be8abbc3374fd6633b0dcc858b9521138903fd6967
Oct 30 19:25:25.589231 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.589194    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:25.739950 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.739866    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:25.783191 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.783158    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"]
Oct 30 19:25:25.785241 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.785225    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:25.809660 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.809624    2583 generic.go:356] "Generic (PLEG): container finished" podID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerID="30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56" exitCode=0
Oct 30 19:25:25.810082 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.809699    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerDied","Data":"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"}
Oct 30 19:25:25.811000 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.810974    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg" event={"ID":"d78689c3-56b1-481c-9ef7-bf81b9a9679e","Type":"ContainerStarted","Data":"8834f4b1de471ce7857364be8abbc3374fd6633b0dcc858b9521138903fd6967"}
Oct 30 19:25:25.845577 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.845545    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"]
Oct 30 19:25:25.876749 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.876708    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sd2hg\""
Oct 30 19:25:25.876916 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.876763    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 19:25:25.909586 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.909551    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:25.918559 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.918529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ca4d390-4036-4689-8ecd-d13b149ff6ba-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k7fj6\" (UID: \"0ca4d390-4036-4689-8ecd-d13b149ff6ba\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:25.918669 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:25.918654    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjkkg\" (UniqueName: \"kubernetes.io/projected/0ca4d390-4036-4689-8ecd-d13b149ff6ba-kube-api-access-tjkkg\") pod \"monitoring-plugin-77f4f76594-k7fj6\" (UID: \"0ca4d390-4036-4689-8ecd-d13b149ff6ba\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:26.020302 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.020213    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ca4d390-4036-4689-8ecd-d13b149ff6ba-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k7fj6\" (UID: \"0ca4d390-4036-4689-8ecd-d13b149ff6ba\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:26.020302 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.020267    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjkkg\" (UniqueName: \"kubernetes.io/projected/0ca4d390-4036-4689-8ecd-d13b149ff6ba-kube-api-access-tjkkg\") pod \"monitoring-plugin-77f4f76594-k7fj6\" (UID: \"0ca4d390-4036-4689-8ecd-d13b149ff6ba\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:26.022867 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.022840    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ca4d390-4036-4689-8ecd-d13b149ff6ba-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k7fj6\" (UID: \"0ca4d390-4036-4689-8ecd-d13b149ff6ba\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:26.051950 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.051914    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56bf65fd49-dp7vl"]
Oct 30 19:25:26.054211 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.054191    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.079029 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.079000    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjkkg\" (UniqueName: \"kubernetes.io/projected/0ca4d390-4036-4689-8ecd-d13b149ff6ba-kube-api-access-tjkkg\") pod \"monitoring-plugin-77f4f76594-k7fj6\" (UID: \"0ca4d390-4036-4689-8ecd-d13b149ff6ba\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:26.095902 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.095865    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:26.104482 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.104451    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 19:25:26.104572 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.104556    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 19:25:26.112059 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.112032    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56bf65fd49-dp7vl"]
Oct 30 19:25:26.175530 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.175505    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 19:25:26.175530 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.175503    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 19:25:26.175730 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.175710    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-48djs\""
Oct 30 19:25:26.175818 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.175791    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6rdh1lpcl4r57\""
Oct 30 19:25:26.222242 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.222206    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/69657bb8-0d16-4aeb-9388-5184569b0114-audit-log\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.222242 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.222240    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-client-ca-bundle\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.222439 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.222265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-client-certs\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.222439 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.222288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-metrics-server-audit-profiles\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.222439 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.222419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-tls\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.222543 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.222448    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.222543 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.222489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhffg\" (UniqueName: \"kubernetes.io/projected/69657bb8-0d16-4aeb-9388-5184569b0114-kube-api-access-jhffg\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.323846 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.323789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-client-certs\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.324083 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.323859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-metrics-server-audit-profiles\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.324083 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.323934    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-tls\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.324083 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.323960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.324083 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.324018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhffg\" (UniqueName: \"kubernetes.io/projected/69657bb8-0d16-4aeb-9388-5184569b0114-kube-api-access-jhffg\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.324083 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.324071    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/69657bb8-0d16-4aeb-9388-5184569b0114-audit-log\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.324321 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.324094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-client-ca-bundle\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.324511 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.324482    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/69657bb8-0d16-4aeb-9388-5184569b0114-audit-log\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.324833 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.324789    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.325020 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.325004    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-metrics-server-audit-profiles\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.326591 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.326570    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-client-ca-bundle\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.327017 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.326995    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-tls\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.327091 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.327078    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-client-certs\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.383196 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.383167    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhffg\" (UniqueName: \"kubernetes.io/projected/69657bb8-0d16-4aeb-9388-5184569b0114-kube-api-access-jhffg\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.468347 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.468311    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"]
Oct 30 19:25:26.475024 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:26.474965    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca4d390_4036_4689_8ecd_d13b149ff6ba.slice/crio-0a2c3e34824042a5d977ef79e27e545609449943c1251b38756f6186d0c540d0 WatchSource:0}: Error finding container 0a2c3e34824042a5d977ef79e27e545609449943c1251b38756f6186d0c540d0: Status 404 returned error can't find the container with id 0a2c3e34824042a5d977ef79e27e545609449943c1251b38756f6186d0c540d0
Oct 30 19:25:26.664951 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.664846    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:26.816762 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.816724    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6" event={"ID":"0ca4d390-4036-4689-8ecd-d13b149ff6ba","Type":"ContainerStarted","Data":"0a2c3e34824042a5d977ef79e27e545609449943c1251b38756f6186d0c540d0"}
Oct 30 19:25:26.897744 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.897708    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"]
Oct 30 19:25:26.900518 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.900492    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:26.951033 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.950944    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 19:25:26.999481 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.999178    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"]
Oct 30 19:25:26.999481 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:26.999443    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 19:25:27.024113 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.024077    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 19:25:27.024301 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.024138    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 19:25:27.024301 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.024209    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-h7j6c\""
Oct 30 19:25:27.024301 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.024253    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 19:25:27.024454 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.024316    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 19:25:27.030080 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.030043    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcrpv\" (UniqueName: \"kubernetes.io/projected/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-kube-api-access-hcrpv\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.030247 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.030118    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.030247 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.030153    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-metrics-client-ca\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.030247 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.030195    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-client-tls\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.030247 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.030227    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-serving-certs-ca-bundle\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.030492 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.030257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-federate-client-tls\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.030492 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.030272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.030492 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.030324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.078921 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.078888    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56bf65fd49-dp7vl"]
Oct 30 19:25:27.131519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.130769    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcrpv\" (UniqueName: \"kubernetes.io/projected/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-kube-api-access-hcrpv\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.131519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.130870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.131519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.130907    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-metrics-client-ca\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.131519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.130939    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-client-tls\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.131519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.130986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-serving-certs-ca-bundle\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.131519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.131026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-federate-client-tls\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.131519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.131051    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.131519 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.131120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.132226 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.132179    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-metrics-client-ca\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.132291 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.132260    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-serving-certs-ca-bundle\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.132940 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.132913    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.134091 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.134066    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.134417 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.134389    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-federate-client-tls\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.134527 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.134508    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-client-tls\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.135297 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.135272    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.146488 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.146458    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:27.146601 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.146518    2583 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:27.152448 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.152424    2583 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:27.190849 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.190800    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcrpv\" (UniqueName: \"kubernetes.io/projected/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-kube-api-access-hcrpv\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.217577 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.217490    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:27.628924 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.628886    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"]
Oct 30 19:25:27.634483 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:27.634446    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc905dc2_23e8_4237_8874_f2e9d8ae50a4.slice/crio-8b5efa79e520049c2f23a7aa737ae2d169ba8be7fa2766dacd02381ffe2e6667 WatchSource:0}: Error finding container 8b5efa79e520049c2f23a7aa737ae2d169ba8be7fa2766dacd02381ffe2e6667: Status 404 returned error can't find the container with id 8b5efa79e520049c2f23a7aa737ae2d169ba8be7fa2766dacd02381ffe2e6667
Oct 30 19:25:27.824628 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.824551    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl" event={"ID":"69657bb8-0d16-4aeb-9388-5184569b0114","Type":"ContainerStarted","Data":"d769b475fa5604f0de0920b2bf1b7440ad040f337324ec013d53ca1377dd8bf6"}
Oct 30 19:25:27.827468 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.827436    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x" event={"ID":"cc905dc2-23e8-4237-8874-f2e9d8ae50a4","Type":"ContainerStarted","Data":"8b5efa79e520049c2f23a7aa737ae2d169ba8be7fa2766dacd02381ffe2e6667"}
Oct 30 19:25:27.832845 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:27.832589    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:28.840143 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:28.840105    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerStarted","Data":"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"}
Oct 30 19:25:28.840571 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:28.840194    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerStarted","Data":"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"}
Oct 30 19:25:28.840571 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:28.840235    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerStarted","Data":"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"}
Oct 30 19:25:28.840571 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:28.840273    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerStarted","Data":"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"}
Oct 30 19:25:28.840571 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:28.840315    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerStarted","Data":"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"}
Oct 30 19:25:28.843863 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:28.843693    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg" event={"ID":"d78689c3-56b1-481c-9ef7-bf81b9a9679e","Type":"ContainerStarted","Data":"9b7d6826721c824328e9d96b75ecaaca070f0b4b502b0a63c2ada1c9c64315bc"}
Oct 30 19:25:28.843863 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:28.843771    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg" event={"ID":"d78689c3-56b1-481c-9ef7-bf81b9a9679e","Type":"ContainerStarted","Data":"7f90a22388a306179b282baa26a1d6f1882dcdb54b0e1fff0e821a0dde72b417"}
Oct 30 19:25:28.846707 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:28.846674    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6" event={"ID":"0ca4d390-4036-4689-8ecd-d13b149ff6ba","Type":"ContainerStarted","Data":"9525f0d861b8c81a4752f7bdb900612e25e4f0facb961195ab38ed05eb16f727"}
Oct 30 19:25:28.846882 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:28.846865    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:28.854468 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:28.854447    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:28.959103 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:28.959001    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6" podStartSLOduration=1.775134759 podStartE2EDuration="3.958982322s" totalImagesPullingTime="2.183847563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:28.957080463 +0000 UTC m=+64.108541632" watchObservedRunningTime="2026-10-30 19:25:28.958982322 +0000 UTC m=+64.110443490"
Oct 30 19:25:29.854790 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:29.854703    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerStarted","Data":"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"}
Oct 30 19:25:29.857314 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:29.857286    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl" event={"ID":"69657bb8-0d16-4aeb-9388-5184569b0114","Type":"ContainerStarted","Data":"50c1d2c390132bc9f180acc694fb3410444bc1233053fd0db7db5a301e62dccd"}
Oct 30 19:25:29.860655 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:29.860626    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg" event={"ID":"d78689c3-56b1-481c-9ef7-bf81b9a9679e","Type":"ContainerStarted","Data":"6a1caf691be2585a06ea371b01e123a85ad6878a66211c46647b00ad635c5e6e"}
Oct 30 19:25:29.860780 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:29.860694    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg" event={"ID":"d78689c3-56b1-481c-9ef7-bf81b9a9679e","Type":"ContainerStarted","Data":"3147aa7233de59cb4155f2e83b026858006303ebac1e3692bbf0da1f8579ec8a"}
Oct 30 19:25:29.860780 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:29.860730    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg" event={"ID":"d78689c3-56b1-481c-9ef7-bf81b9a9679e","Type":"ContainerStarted","Data":"953367b8968ddebedbcf642ff8d88640f8fb6aa0f6d1699ed593fac032766bf3"}
Oct 30 19:25:30.005113 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.005060    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.264158625 podStartE2EDuration="7.005045503s" totalImagesPullingTime="4.726491047s" totalInitContainerRuntime="14.395831ms" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:30.003057715 +0000 UTC m=+65.154518899" watchObservedRunningTime="2026-10-30 19:25:30.005045503 +0000 UTC m=+65.156506668"
Oct 30 19:25:30.116340 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.116290    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl" podStartSLOduration=1.938910232 podStartE2EDuration="4.116273634s" totalImagesPullingTime="2.177363402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:30.11570638 +0000 UTC m=+65.267167545" watchObservedRunningTime="2026-10-30 19:25:30.116273634 +0000 UTC m=+65.267734799"
Oct 30 19:25:30.400116 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.400037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:30.446465 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.446436    2583 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 19:25:30.449367 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.449347    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.467891 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.467859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:30.468039 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.467968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:30.512990 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.512965    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 19:25:30.513132 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.513008    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 19:25:30.514272 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.514258    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 19:25:30.514605 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.514594    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 19:25:30.516215 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.516194    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 19:25:30.517548 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.517527    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 19:25:30.518099 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518083    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 19:25:30.518286 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518263    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 19:25:30.518403 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518367    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 19:25:30.518403 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518370    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 19:25:30.518496 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518408    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 19:25:30.518496 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518424    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 19:25:30.518496 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518432    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 19:25:30.518496 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518443    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 19:25:30.518656 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518564    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7ugdki2ohn280\""
Oct 30 19:25:30.518656 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518571    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 19:25:30.518656 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518576    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tg4xp\""
Oct 30 19:25:30.518656 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.518601    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 19:25:30.520626 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.520599    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:30.520702 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.520631    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:30.558866 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.558833    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 19:25:30.569163 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:30.569324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569210    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569284    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569324 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569467 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569337    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-web-config\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569467 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569358    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569467 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569438    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569561 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569561 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569542    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569632 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569632 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk7v4\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-kube-api-access-wk7v4\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569748 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569663    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-config-out\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569748 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569694    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569869 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569787    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569869 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569846    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569972 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569885    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.569972 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.569929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.570063 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.570014    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.570063 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.570045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-config\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.570138 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.570070    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.617707 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.617676    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 19:25:30.668365 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.668290    2583 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 19:25:30.670651 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.670632    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.670712 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.670661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.670712 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.670694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.670785 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.670722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-config\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.670785 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.670746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.670895 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.670789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.670895 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.670851    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.671513 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.671486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.671883 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.671862    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.672003 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.671987    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-web-config\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.672110 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.672095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.672214 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.672198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.672337 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.672322    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.672452 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.672438    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.672560 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.672545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.672652 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.672639    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk7v4\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-kube-api-access-wk7v4\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.672750 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.672736    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-config-out\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.672881 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.672865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.672997 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.672982    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.673098 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.673085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.673590 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.671552    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.674399 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.674263    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-config\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.676126 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.672330    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.681598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.676688    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.681598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.678052    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.681598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.678784    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-config-out\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.681598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.679198    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.681598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.672933    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.681598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.680076    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.681598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.680661    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.681598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.681238    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.681598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.681379    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:30.681598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.681524    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.681598 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.681548    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.682251 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.681876    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.682251 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.681975    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-web-config\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.682497 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.682471    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.682620 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.682516    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.682704 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.682628    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.682760 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.682731    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.692898 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.692876    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-vwkbz\""
Oct 30 19:25:30.694957 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.694932    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:30.713490 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.713469    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4g88n\""
Oct 30 19:25:30.714780 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.714755    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:30.742229 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.742201    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk7v4\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-kube-api-access-wk7v4\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.767685 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.767415    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:30.774562 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.774533    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:30.867254 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.867217    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg" event={"ID":"d78689c3-56b1-481c-9ef7-bf81b9a9679e","Type":"ContainerStarted","Data":"5be650e90b0754865f20799a5ce663439e920aa42164418e702f56644e76fd88"}
Oct 30 19:25:30.867657 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.867364    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:30.869298 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.869273    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x" event={"ID":"cc905dc2-23e8-4237-8874-f2e9d8ae50a4","Type":"ContainerStarted","Data":"68175ce039dbb3ce5d6d73e9f7d3b373552f24ea7a3978028a9357fe23746397"}
Oct 30 19:25:30.869413 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.869329    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x" event={"ID":"cc905dc2-23e8-4237-8874-f2e9d8ae50a4","Type":"ContainerStarted","Data":"688a5d77f8ee67e37dd641ab1a0e23d2e136e32de1741154c382d42dfff2b499"}
Oct 30 19:25:30.869413 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.869349    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x" event={"ID":"cc905dc2-23e8-4237-8874-f2e9d8ae50a4","Type":"ContainerStarted","Data":"a3d92ab4f49ee49d532d3ee1bf0f2c82924f08dd09f0e1586bba06e10018316c"}
Oct 30 19:25:30.977918 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.977742    2583 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9jbqb\""
Oct 30 19:25:30.979207 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:30.979186    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:31.011985 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.011926    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x" podStartSLOduration=2.732353621 podStartE2EDuration="5.011906353s" totalImagesPullingTime="2.279552732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:31.011777416 +0000 UTC m=+66.163238601" watchObservedRunningTime="2026-10-30 19:25:31.011906353 +0000 UTC m=+66.163367520"
Oct 30 19:25:31.067706 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.067677    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xmsrx"]
Oct 30 19:25:31.073362 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:31.073335    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c3af0c_ac42_4a11_9fbd_ebc48700b9d2.slice/crio-fd70697a3b50239e6aaee4da49932fef768d4281dd5434ba17917dce9853f20e WatchSource:0}: Error finding container fd70697a3b50239e6aaee4da49932fef768d4281dd5434ba17917dce9853f20e: Status 404 returned error can't find the container with id fd70697a3b50239e6aaee4da49932fef768d4281dd5434ba17917dce9853f20e
Oct 30 19:25:31.118927 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.118895    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hs2pz"]
Oct 30 19:25:31.124853 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:31.124825    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4c7c1f_b9ad_492d_bbf8_b9bf4ac98d24.slice/crio-23e4c7532d922897b2cfe523c247394c52db9b9db6e18256174b24aa87fd3c3f WatchSource:0}: Error finding container 23e4c7532d922897b2cfe523c247394c52db9b9db6e18256174b24aa87fd3c3f: Status 404 returned error can't find the container with id 23e4c7532d922897b2cfe523c247394c52db9b9db6e18256174b24aa87fd3c3f
Oct 30 19:25:31.132279 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.132236    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg" podStartSLOduration=3.146870399 podStartE2EDuration="7.132223177s" totalImagesPullingTime="3.985352778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:31.131433721 +0000 UTC m=+66.282894890" watchObservedRunningTime="2026-10-30 19:25:31.132223177 +0000 UTC m=+66.283684343"
Oct 30 19:25:31.196784 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.196741    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 19:25:31.202429 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:31.202394    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605f1852_7ec7_4c02_938a_6d654d7e70bc.slice/crio-5b868cbfc187e337b3b43a80e9eeb3d71b885dbcf9f37e65cf435a701400589d WatchSource:0}: Error finding container 5b868cbfc187e337b3b43a80e9eeb3d71b885dbcf9f37e65cf435a701400589d: Status 404 returned error can't find the container with id 5b868cbfc187e337b3b43a80e9eeb3d71b885dbcf9f37e65cf435a701400589d
Oct 30 19:25:31.350685 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.350652    2583 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q9pln"]
Oct 30 19:25:31.357745 ip-10-0-130-34 kubenswrapper[2583]: W1030 19:25:31.357714    2583 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81010882_395a_4762_b410_527c640e91ed.slice/crio-0e7c1ce9b0deea5a68e71f3de90602e8e7a1d984d7374b619b38aea279c07338 WatchSource:0}: Error finding container 0e7c1ce9b0deea5a68e71f3de90602e8e7a1d984d7374b619b38aea279c07338: Status 404 returned error can't find the container with id 0e7c1ce9b0deea5a68e71f3de90602e8e7a1d984d7374b619b38aea279c07338
Oct 30 19:25:31.874534 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.874500    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q9pln" event={"ID":"81010882-395a-4762-b410-527c640e91ed","Type":"ContainerStarted","Data":"0e7c1ce9b0deea5a68e71f3de90602e8e7a1d984d7374b619b38aea279c07338"}
Oct 30 19:25:31.875674 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.875652    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hs2pz" event={"ID":"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24","Type":"ContainerStarted","Data":"23e4c7532d922897b2cfe523c247394c52db9b9db6e18256174b24aa87fd3c3f"}
Oct 30 19:25:31.876745 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.876726    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xmsrx" event={"ID":"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2","Type":"ContainerStarted","Data":"fd70697a3b50239e6aaee4da49932fef768d4281dd5434ba17917dce9853f20e"}
Oct 30 19:25:31.878246 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.878224    2583 generic.go:356] "Generic (PLEG): container finished" podID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerID="ee5cd0214c4bf3bd48520aca619f9ffbe32b5c532c1d3e6cf0eeac0aff27e98e" exitCode=0
Oct 30 19:25:31.878364 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.878342    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerDied","Data":"ee5cd0214c4bf3bd48520aca619f9ffbe32b5c532c1d3e6cf0eeac0aff27e98e"}
Oct 30 19:25:31.878413 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.878399    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerStarted","Data":"5b868cbfc187e337b3b43a80e9eeb3d71b885dbcf9f37e65cf435a701400589d"}
Oct 30 19:25:31.978529 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:31.978495    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:32.148415 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:32.148325    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:32.320747 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:32.320707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:32.523006 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:32.522850    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:32.732521 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:32.732474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:32.889275 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:32.889214    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:33.248895 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:33.248835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:33.525148 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:33.525067    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:33.891339 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:33.891298    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hs2pz" event={"ID":"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24","Type":"ContainerStarted","Data":"182aba379b8e6c19269c2efe5815e3572438240fcb391b1c08f67abf6ed9c0db"}
Oct 30 19:25:33.891782 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:33.891369    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hs2pz" event={"ID":"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24","Type":"ContainerStarted","Data":"827cd4dda9e858d2b73160f7685c6f7f9366a3ee4e929eced210c3aa9dd8a3a2"}
Oct 30 19:25:34.013537 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:34.012540    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hs2pz" podStartSLOduration=67.340802104 podStartE2EDuration="1m9.01252361s" totalImagesPullingTime="1.671721506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:34.011199588 +0000 UTC m=+69.162660751" watchObservedRunningTime="2026-10-30 19:25:34.01252361 +0000 UTC m=+69.163984773"
Oct 30 19:25:34.026351 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:34.026187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:34.227662 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:34.227586    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:35.903113 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:35.903034    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q9pln" event={"ID":"81010882-395a-4762-b410-527c640e91ed","Type":"ContainerStarted","Data":"f34c8f45597a2fd07b8dc7e37cce56d67f1fdd900f5077090da37df54880ce4e"}
Oct 30 19:25:35.903514 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:35.903308    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:36.015124 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:36.015060    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q9pln" podStartSLOduration=66.764700517 podStartE2EDuration="1m11.015042341s" totalImagesPullingTime="4.250341824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:36.014318999 +0000 UTC m=+71.165780167" watchObservedRunningTime="2026-10-30 19:25:36.015042341 +0000 UTC m=+71.166503509"
Oct 30 19:25:36.352607 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:36.352570    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:36.508924 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:36.508889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:36.885852 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:36.885797    2583 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:36.918312 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:36.918268    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerStarted","Data":"f931dfeff5289dca3a89cb2028373a3de37fe93d5cbfb1e06b1cb4dfbe008c0c"}
Oct 30 19:25:36.918739 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:36.918361    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerStarted","Data":"429c3c4f1fd094c0b6642ac008c6da3907097e28876689308a4d9e34a41de9a0"}
Oct 30 19:25:36.918739 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:36.918406    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerStarted","Data":"a9789abbb28eb399c90b5ac3382af04386d7c9b48da565ae3ff98e5b48f7e9cd"}
Oct 30 19:25:36.918739 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:36.918433    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerStarted","Data":"8ae93931750ca265d49c16803e4af9f9d3c8a0d5a04eced20c73b598a9f41a35"}
Oct 30 19:25:36.918739 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:36.918465    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerStarted","Data":"2e1fd745164112d2f7141031f7671ca74ba28709e0b3b4b4d83df0f5e2cc0836"}
Oct 30 19:25:36.918739 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:36.918513    2583 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerStarted","Data":"08c0d5510ae8c459daea916be962e56457a9d51cd891aea1671e0f2f6c66afee"}
Oct 30 19:25:37.183233 ip-10-0-130-34 kubenswrapper[2583]: I1030 19:25:37.183185    2583 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8005731579999997 podStartE2EDuration="7.1831701s" totalImagesPullingTime="4.365503677s" totalInitContainerRuntime="17.093265ms" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:37.182674533 +0000 UTC m=+72.334135700" watchObservedRunningTime="2026-10-30 19:25:37.1831701 +0000 UTC m=+72.334631266"
Oct 30 19:25:37.391784 ip-10-0-130-34 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 19:25:37.403258 ip-10-0-130-34 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 19:25:37.403442 ip-10-0-130-34 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 19:25:37.403498 ip-10-0-130-34 systemd[1]: kubelet.service: Consumed 5.031s CPU time.
Oct 30 19:25:37.420358 ip-10-0-130-34 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 19:25:37.488318 ip-10-0-130-34 kubenswrapper[6015]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:25:37.488318 ip-10-0-130-34 kubenswrapper[6015]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 19:25:37.488318 ip-10-0-130-34 kubenswrapper[6015]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:25:37.488318 ip-10-0-130-34 kubenswrapper[6015]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 19:25:37.490468 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490378    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:25:37.490468 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490469    6015 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:25:37.490468 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490473    6015 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490476    6015 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490479    6015 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490482    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490485    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490487    6015 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490490    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490492    6015 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490500    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490504    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490506    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490509    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490512    6015 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490514    6015 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490517    6015 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490519    6015 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490522    6015 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490525    6015 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490527    6015 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490530    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:25:37.490563 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490534    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490536    6015 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490539    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490541    6015 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490544    6015 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490547    6015 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490549    6015 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490552    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490555    6015 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490558    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490561    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490564    6015 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490566    6015 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490569    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490572    6015 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490574    6015 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490577    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490579    6015 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490582    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:25:37.491069 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490585    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490588    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490591    6015 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490594    6015 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490596    6015 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490599    6015 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490601    6015 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490603    6015 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490606    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490608    6015 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490611    6015 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490613    6015 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490616    6015 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490619    6015 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490621    6015 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490624    6015 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490627    6015 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490630    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490632    6015 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490635    6015 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:25:37.491686 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490637    6015 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490641    6015 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490644    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490646    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490649    6015 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490651    6015 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490654    6015 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490656    6015 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490660    6015 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490662    6015 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490665    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490668    6015 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490671    6015 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490673    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490676    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490678    6015 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490681    6015 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490683    6015 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490686    6015 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490688    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:25:37.492208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490691    6015 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490694    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490696    6015 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490699    6015 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490702    6015 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490704    6015 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490707    6015 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490710    6015 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490713    6015 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490715    6015 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490718    6015 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490720    6015 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490723    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490726    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490730    6015 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490734    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490738    6015 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490742    6015 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:25:37.492737 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490745    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490748    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490750    6015 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490753    6015 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490755    6015 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490758    6015 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.490761    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491561    6015 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491569    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491573    6015 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491576    6015 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491578    6015 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491581    6015 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491584    6015 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491586    6015 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491589    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491593    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491595    6015 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491598    6015 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:25:37.494117 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491601    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491603    6015 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491606    6015 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491609    6015 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491612    6015 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491614    6015 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491617    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491620    6015 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491622    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491625    6015 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491627    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491630    6015 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491633    6015 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491635    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491638    6015 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491640    6015 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491643    6015 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491645    6015 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491648    6015 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491650    6015 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:25:37.494609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491654    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491656    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491659    6015 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491662    6015 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491664    6015 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491667    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491669    6015 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491671    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491674    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491677    6015 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491680    6015 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491682    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491685    6015 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491688    6015 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491691    6015 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491694    6015 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491696    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491701    6015 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491704    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:25:37.495107 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491708    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491711    6015 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491714    6015 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491716    6015 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491719    6015 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491722    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491725    6015 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491727    6015 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491730    6015 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491733    6015 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491735    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491738    6015 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491741    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491743    6015 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491747    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491749    6015 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491752    6015 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491756    6015 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491760    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:25:37.495621 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491763    6015 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491766    6015 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491769    6015 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491772    6015 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491774    6015 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491777    6015 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491779    6015 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491782    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491784    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491787    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491789    6015 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491791    6015 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491794    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491796    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491799    6015 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491820    6015 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491824    6015 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491829    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491833    6015 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:25:37.496096 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491836    6015 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491838    6015 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491841    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491844    6015 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491846    6015 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491849    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491852    6015 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491854    6015 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491857    6015 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491860    6015 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491863    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491866    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491868    6015 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491871    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491873    6015 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491876    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.491879    6015 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492409    6015 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492414    6015 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492417    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:25:37.496609 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492420    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492422    6015 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492425    6015 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492428    6015 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492430    6015 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492433    6015 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492435    6015 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492438    6015 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492441    6015 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492443    6015 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492446    6015 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492448    6015 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492451    6015 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492454    6015 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492457    6015 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492459    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492462    6015 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492464    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492467    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:25:37.497183 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492470    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492472    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492475    6015 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492477    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492480    6015 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492482    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492485    6015 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492488    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492491    6015 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492493    6015 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492496    6015 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492498    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492501    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492504    6015 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492506    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492509    6015 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492512    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492514    6015 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492517    6015 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492519    6015 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:25:37.497641 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492522    6015 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492524    6015 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492527    6015 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492530    6015 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492532    6015 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492535    6015 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492537    6015 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492540    6015 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492542    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492545    6015 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492547    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492550    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492552    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492554    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492557    6015 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492561    6015 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492563    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492566    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492568    6015 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:25:37.498148 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492571    6015 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492574    6015 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492576    6015 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492579    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492581    6015 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492584    6015 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492586    6015 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492588    6015 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492591    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492593    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492596    6015 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492598    6015 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492601    6015 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492603    6015 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492606    6015 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492608    6015 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492612    6015 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492616    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492619    6015 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492621    6015 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:25:37.498670 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492624    6015 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492627    6015 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492633    6015 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492636    6015 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492638    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492641    6015 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492643    6015 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492646    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492649    6015 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492652    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492655    6015 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492657    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492660    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492662    6015 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492665    6015 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492667    6015 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492670    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492672    6015 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492675    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:25:37.499538 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492677    6015 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492680    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492684    6015 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492687    6015 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492690    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.492693    6015 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492788    6015 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492795    6015 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492818    6015 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492823    6015 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492827    6015 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492830    6015 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492834    6015 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492838    6015 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492841    6015 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492846    6015 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492850    6015 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492854    6015 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492856    6015 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492860    6015 flags.go:64] FLAG: --cgroup-root=""
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492865    6015 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492868    6015 flags.go:64] FLAG: --client-ca-file=""
Oct 30 19:25:37.500206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492871    6015 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492875    6015 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492879    6015 flags.go:64] FLAG: --cluster-domain=""
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492882    6015 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492885    6015 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492888    6015 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492892    6015 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492895    6015 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492899    6015 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492902    6015 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492905    6015 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492908    6015 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492911    6015 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492914    6015 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492917    6015 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492920    6015 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492924    6015 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492927    6015 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492930    6015 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492933    6015 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492936    6015 flags.go:64] FLAG: --enable-server="true"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492939    6015 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492946    6015 flags.go:64] FLAG: --event-burst="100"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492950    6015 flags.go:64] FLAG: --event-qps="50"
Oct 30 19:25:37.500738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492952    6015 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492957    6015 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492960    6015 flags.go:64] FLAG: --eviction-hard=""
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492964    6015 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492967    6015 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492971    6015 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492975    6015 flags.go:64] FLAG: --eviction-soft=""
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492979    6015 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492981    6015 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492984    6015 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492988    6015 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492991    6015 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492994    6015 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.492997    6015 flags.go:64] FLAG: --feature-gates=""
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493001    6015 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493004    6015 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493008    6015 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493011    6015 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493014    6015 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493017    6015 flags.go:64] FLAG: --help="false"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493020    6015 flags.go:64] FLAG: --hostname-override="ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493023    6015 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493026    6015 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 19:25:37.501374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493029    6015 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493033    6015 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493037    6015 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493040    6015 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493043    6015 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493045    6015 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493048    6015 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493051    6015 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493054    6015 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493057    6015 flags.go:64] FLAG: --kube-reserved=""
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493061    6015 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493064    6015 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493067    6015 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493069    6015 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493072    6015 flags.go:64] FLAG: --lock-file=""
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493076    6015 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493079    6015 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493082    6015 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493087    6015 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493090    6015 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493094    6015 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493097    6015 flags.go:64] FLAG: --logging-format="text"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493100    6015 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493104    6015 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 19:25:37.501943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493106    6015 flags.go:64] FLAG: --manifest-url=""
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493109    6015 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493114    6015 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493117    6015 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493121    6015 flags.go:64] FLAG: --max-pods="110"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493123    6015 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493127    6015 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493130    6015 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493134    6015 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493137    6015 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493140    6015 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493143    6015 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493150    6015 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493153    6015 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493156    6015 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493159    6015 flags.go:64] FLAG: --pod-cidr=""
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493162    6015 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493164    6015 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493169    6015 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493171    6015 flags.go:64] FLAG: --port="10250"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493175    6015 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493177    6015 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-03a501831e32572b9"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493180    6015 flags.go:64] FLAG: --qos-reserved=""
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493185    6015 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493188    6015 flags.go:64] FLAG: --register-node="true"
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493190    6015 flags.go:64] FLAG: --register-with-taints=""
Oct 30 19:25:37.502525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493194    6015 flags.go:64] FLAG: --registry-burst="10"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493197    6015 flags.go:64] FLAG: --registry-qps="5"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493200    6015 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493204    6015 flags.go:64] FLAG: --reserved-memory=""
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493208    6015 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493211    6015 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493214    6015 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493217    6015 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493220    6015 flags.go:64] FLAG: --runonce="false"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493223    6015 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493226    6015 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493229    6015 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493232    6015 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493235    6015 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493238    6015 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493241    6015 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493244    6015 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493247    6015 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493250    6015 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493253    6015 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493256    6015 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493259    6015 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493262    6015 flags.go:64] FLAG: --system-cgroups=""
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493265    6015 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493271    6015 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 19:25:37.503162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493274    6015 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493277    6015 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493281    6015 flags.go:64] FLAG: --tls-min-version=""
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493284    6015 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493289    6015 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493292    6015 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493295    6015 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493298    6015 flags.go:64] FLAG: --v="2"
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493303    6015 flags.go:64] FLAG: --version="false"
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493308    6015 flags.go:64] FLAG: --vmodule=""
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493312    6015 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493315    6015 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493453    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493457    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493461    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493463    6015 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493466    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493469    6015 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493471    6015 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493474    6015 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493476    6015 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493479    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:25:37.503771 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493481    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493484    6015 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493487    6015 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493489    6015 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493492    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493494    6015 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493497    6015 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493500    6015 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493502    6015 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493506    6015 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493508    6015 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493511    6015 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493514    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493516    6015 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493520    6015 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493522    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493525    6015 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493527    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493530    6015 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493532    6015 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:25:37.504482 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493535    6015 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493537    6015 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493540    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493543    6015 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493545    6015 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493547    6015 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493550    6015 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493552    6015 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493555    6015 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493557    6015 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493559    6015 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493562    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493565    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493567    6015 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493570    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493572    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493575    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493577    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493580    6015 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493583    6015 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:25:37.505262 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493586    6015 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493589    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493592    6015 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493595    6015 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493599    6015 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493602    6015 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493608    6015 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493611    6015 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493614    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493617    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493620    6015 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493622    6015 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493624    6015 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493627    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493629    6015 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493636    6015 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493639    6015 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493641    6015 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493644    6015 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:25:37.505793 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493646    6015 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493648    6015 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493651    6015 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493653    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493656    6015 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493658    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493661    6015 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493663    6015 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493666    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493668    6015 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493671    6015 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493673    6015 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493676    6015 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493678    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493682    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493684    6015 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493687    6015 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493690    6015 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493692    6015 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:25:37.506320 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493696    6015 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493699    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493701    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493704    6015 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493706    6015 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493709    6015 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493711    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493713    6015 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493716    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493718    6015 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493721    6015 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493724    6015 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493726    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493729    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493731    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493734    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493736    6015 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:25:37.506831 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493739    6015 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.493764    6015 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493820    6015 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493825    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493828    6015 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493830    6015 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493833    6015 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493835    6015 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493838    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493840    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493843    6015 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493847    6015 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493850    6015 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493852    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493855    6015 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493860    6015 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:25:37.507386 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493862    6015 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493865    6015 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493867    6015 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493870    6015 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493872    6015 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493875    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493878    6015 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493880    6015 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493883    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493885    6015 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493888    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493891    6015 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493893    6015 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493896    6015 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493898    6015 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493901    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493903    6015 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493906    6015 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493908    6015 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:25:37.508024 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493911    6015 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493913    6015 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493915    6015 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493918    6015 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493920    6015 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493923    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493926    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493928    6015 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493932    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493934    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493937    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493940    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493943    6015 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493946    6015 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493948    6015 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493951    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493954    6015 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493956    6015 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493960    6015 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:25:37.508701 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493963    6015 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493968    6015 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493972    6015 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493975    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493978    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493981    6015 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493983    6015 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493986    6015 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493988    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493991    6015 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493993    6015 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493996    6015 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.493998    6015 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494000    6015 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494003    6015 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494005    6015 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494008    6015 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494010    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494012    6015 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:25:37.509594 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494015    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494017    6015 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494021    6015 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494023    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494026    6015 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494028    6015 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494032    6015 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494035    6015 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494038    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494040    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494043    6015 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494045    6015 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494048    6015 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494050    6015 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494053    6015 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494055    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494058    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494061    6015 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494063    6015 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:25:37.510410 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494066    6015 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494068    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494071    6015 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494073    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494075    6015 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494078    6015 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494080    6015 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494083    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494086    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494088    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494090    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494093    6015 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494095    6015 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494098    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494100    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.494105    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.498093    6015 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.498109    6015 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.498127    6015 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 19:25:37.511218 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.498132    6015 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498189    6015 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498194    6015 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498197    6015 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498200    6015 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498212    6015 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498215    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498218    6015 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498221    6015 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498224    6015 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498226    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498229    6015 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498232    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498234    6015 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498237    6015 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498240    6015 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498243    6015 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498246    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498249    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498251    6015 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:25:37.512052 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498254    6015 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498257    6015 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498259    6015 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498262    6015 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498264    6015 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498267    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498270    6015 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498273    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498275    6015 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498278    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498282    6015 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498285    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498288    6015 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498291    6015 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498294    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498297    6015 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498299    6015 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498302    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498304    6015 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498307    6015 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:25:37.513004 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498309    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498312    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498314    6015 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498317    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498321    6015 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498325    6015 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498329    6015 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498332    6015 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498335    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498337    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498340    6015 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498344    6015 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498348    6015 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498352    6015 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498355    6015 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498357    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498360    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498362    6015 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498365    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:25:37.513939 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498367    6015 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498370    6015 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498372    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498375    6015 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498378    6015 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498381    6015 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498384    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498387    6015 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498390    6015 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498392    6015 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498395    6015 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498397    6015 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498400    6015 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498402    6015 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498405    6015 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498407    6015 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498410    6015 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498413    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498415    6015 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498418    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:25:37.514745 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498420    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498422    6015 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498425    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498428    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498430    6015 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498433    6015 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498435    6015 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498437    6015 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498440    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498442    6015 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498445    6015 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498447    6015 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498450    6015 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498452    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498455    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498457    6015 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498460    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498463    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498466    6015 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:25:37.515620 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498534    6015 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498539    6015 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498543    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498545    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498548    6015 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498551    6015 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498553    6015 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498597    6015 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.498601    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.498667    6015 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499306    6015 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499319    6015 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499323    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499329    6015 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499333    6015 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499339    6015 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:25:37.516516 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499344    6015 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499348    6015 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499354    6015 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499364    6015 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499369    6015 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499377    6015 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499382    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499386    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499392    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499397    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499405    6015 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499408    6015 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499412    6015 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499417    6015 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499422    6015 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499435    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499441    6015 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499446    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499450    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:25:37.517440 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499454    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499458    6015 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499462    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499466    6015 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499470    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499474    6015 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499478    6015 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499483    6015 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499487    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499496    6015 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499500    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499504    6015 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499508    6015 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499513    6015 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499517    6015 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499521    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499526    6015 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499533    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499538    6015 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499542    6015 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:25:37.518293 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499546    6015 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499550    6015 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499560    6015 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499564    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499568    6015 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499572    6015 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499576    6015 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499580    6015 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499584    6015 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499589    6015 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499594    6015 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499598    6015 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499602    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499606    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499611    6015 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499619    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499624    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499628    6015 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499632    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499636    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:25:37.519318 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499640    6015 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499644    6015 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499651    6015 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499658    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499663    6015 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499668    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499674    6015 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499686    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499691    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499699    6015 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499703    6015 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499708    6015 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499713    6015 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499717    6015 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499722    6015 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499726    6015 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499731    6015 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499735    6015 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499739    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:25:37.520292 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499748    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499752    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499756    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499762    6015 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499766    6015 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499770    6015 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499775    6015 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499779    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499783    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499788    6015 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499792    6015 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499795    6015 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499799    6015 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499823    6015 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499828    6015 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499832    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499836    6015 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499841    6015 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499844    6015 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:25:37.521028 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499849    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499853    6015 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.499857    6015 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.499921    6015 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500032    6015 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500039    6015 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500046    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500050    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500060    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500065    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500072    6015 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500076    6015 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500079    6015 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500081    6015 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500085    6015 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500088    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 19:25:37.521527 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500093    6015 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500099    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500103    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500155    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500278    6015 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500290    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500294    6015 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500298    6015 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500300    6015 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500304    6015 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500307    6015 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500309    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500312    6015 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500315    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500317    6015 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500320    6015 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500323    6015 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500325    6015 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500328    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500331    6015 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 19:25:37.522035 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500333    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500336    6015 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500338    6015 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500341    6015 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500344    6015 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500347    6015 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500349    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500352    6015 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500354    6015 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500357    6015 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500360    6015 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500363    6015 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500366    6015 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500369    6015 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500372    6015 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500375    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500378    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500380    6015 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500383    6015 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500388    6015 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 19:25:37.522864 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500391    6015 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500394    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500396    6015 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500399    6015 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500402    6015 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500406    6015 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500411    6015 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500414    6015 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500417    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500421    6015 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500425    6015 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500429    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500432    6015 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500435    6015 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500438    6015 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500441    6015 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500444    6015 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500446    6015 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500449    6015 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 19:25:37.523568 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500452    6015 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500454    6015 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500457    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500459    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500464    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500467    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500470    6015 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500472    6015 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500475    6015 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500480    6015 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500483    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500485    6015 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500487    6015 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500490    6015 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500492    6015 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500495    6015 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500498    6015 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500500    6015 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500503    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 19:25:37.524112 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500505    6015 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500508    6015 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500510    6015 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500513    6015 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500515    6015 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500518    6015 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500521    6015 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500524    6015 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500527    6015 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500530    6015 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500532    6015 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500535    6015 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500537    6015 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500540    6015 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500542    6015 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:37.500544    6015 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.500619    6015 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.501620    6015 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.501681    6015 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 19:25:37.524650 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.501881    6015 server.go:1014] "Starting client certificate rotation"
Oct 30 19:25:37.525242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.502020    6015 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 19:25:37.525242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.502072    6015 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 19:19:25 +0000 UTC" deadline="2028-04-29 02:50:55.841818674 +0000 UTC"
Oct 30 19:25:37.525242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.502099    6015 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13111h25m18.339721045s"
Oct 30 19:25:37.525242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.502340    6015 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 19:25:37.525242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.503504    6015 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 19:25:37.525242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.504823    6015 log.go:25] "Validated CRI v1 runtime API"
Oct 30 19:25:37.525242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.506939    6015 log.go:25] "Validated CRI v1 image API"
Oct 30 19:25:37.525242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.507687    6015 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 19:25:37.525242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.511583    6015 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 80940766-87bd-40c7-a9f1-a664a92c7f02:/dev/nvme0n1p4 b03100a9-6352-4f48-b363-cc625be0a9dd:/dev/nvme0n1p3]
Oct 30 19:25:37.525532 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.511614    6015 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/06921b140df4761b1fd8ee437587c6be8552aee4ef261ce2f59141f92b2bc69d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/06921b140df4761b1fd8ee437587c6be8552aee4ef261ce2f59141f92b2bc69d/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0a2c3e34824042a5d977ef79e27e545609449943c1251b38756f6186d0c540d0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0a2c3e34824042a5d977ef79e27e545609449943c1251b38756f6186d0c540d0/userdata/shm major:0 minor:353 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0e7c1ce9b0deea5a68e71f3de90602e8e7a1d984d7374b619b38aea279c07338/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0e7c1ce9b0deea5a68e71f3de90602e8e7a1d984d7374b619b38aea279c07338/userdata/shm major:0 minor:485 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/131a3e04a2258e46f03443805d13d12f8b313b8ecbb506053b0483bddfbf5c20/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/131a3e04a2258e46f03443805d13d12f8b313b8ecbb506053b0483bddfbf5c20/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1505bdef70cf34df8f028241df12b5d8c4de801d69baea3d53370a5dae36047e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1505bdef70cf34df8f028241df12b5d8c4de801d69baea3d53370a5dae36047e/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/23e4c7532d922897b2cfe523c247394c52db9b9db6e18256174b24aa87fd3c3f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/23e4c7532d922897b2cfe523c247394c52db9b9db6e18256174b24aa87fd3c3f/userdata/shm major:0 minor:480 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2d854e8a3f11d48b9539a131d049f5005297526af3e6001acb08199214e992b0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2d854e8a3f11d48b9539a131d049f5005297526af3e6001acb08199214e992b0/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/30f0faf425e8933a9257bc2a808d2cb8d79b0407de61f77b0f128a8236be7f54/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/30f0faf425e8933a9257bc2a808d2cb8d79b0407de61f77b0f128a8236be7f54/userdata/shm major:0 minor:274 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3420a6c033bb5ef447aba3ebdfa6d1c0d8e9aa128be3ec2da9c93073485347c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3420a6c033bb5ef447aba3ebdfa6d1c0d8e9aa128be3ec2da9c93073485347c2/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/39439d7ae5b65413793c02a149dc8f0214fe6f657e1670648fde1cd780207426/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/39439d7ae5b65413793c02a149dc8f0214fe6f657e1670648fde1cd780207426/userdata/shm major:0 minor:83 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/46436299dc90e3270dfe9b2afc376efc56db5607e6027d6121e8e7994d44838f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/46436299dc90e3270dfe9b2afc376efc56db5607e6027d6121e8e7994d44838f/userdata/shm major:0 minor:276 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/50e1279c5e004ce798d73a50162d234169f4b3032efa0ada158564816f77b965/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/50e1279c5e004ce798d73a50162d234169f4b3032efa0ada158564816f77b965/userdata/shm major:0 minor:266 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/539c17aa278d6e8e3ffbc588b0d4339a55f2197d41a9ce23cd192f2529b493c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/539c17aa278d6e8e3ffbc588b0d4339a55f2197d41a9ce23cd192f2529b493c2/userdata/shm major:0 minor:306 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5b868cbfc187e337b3b43a80e9eeb3d71b885dbcf9f37e65cf435a701400589d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5b868cbfc187e337b3b43a80e9eeb3d71b885dbcf9f37e65cf435a701400589d/userdata/shm major:0 minor:483 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6dd0e75a833b25ae936a9b0edf3f4ea5e1dd8c92d95676f7cb578bb7fe8a2514/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6dd0e75a833b25ae936a9b0edf3f4ea5e1dd8c92d95676f7cb578bb7fe8a2514/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8039ca1d77eb06f2e90d415c2b9d3d2ae0fc10980530d679cd3fd54c2ac13e3c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8039ca1d77eb06f2e90d415c2b9d3d2ae0fc10980530d679cd3fd54c2ac13e3c/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8834f4b1de471ce7857364be8abbc3374fd6633b0dcc858b9521138903fd6967/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8834f4b1de471ce7857364be8abbc3374fd6633b0dcc858b9521138903fd6967/userdata/shm major:0 minor:347 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8b5efa79e520049c2f23a7aa737ae2d169ba8be7fa2766dacd02381ffe2e6667/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8b5efa79e520049c2f23a7aa737ae2d169ba8be7fa2766dacd02381ffe2e6667/userdata/shm major:0 minor:370 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8ca97d579ff24a1a53a1d57327e8dec74ee34d0b88000382c38598ab25bdf8eb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8ca97d579ff24a1a53a1d57327e8dec74ee34d0b88000382c38598ab25bdf8eb/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a69ae157d81529b9fb51b76dc641a5c199cd00be6c19e35f75e9238a96927d3b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a69ae157d81529b9fb51b76dc641a5c199cd00be6c19e35f75e9238a96927d3b/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ac018828065099ab71a4aa616c89233e5b18ac7e177abefec61071267058dc9e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ac018828065099ab71a4aa616c89233e5b18ac7e177abefec61071267058dc9e/userdata/shm major:0 minor:226 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d769b475fa5604f0de0920b2bf1b7440ad040f337324ec013d53ca1377dd8bf6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d769b475fa5604f0de0920b2bf1b7440ad040f337324ec013d53ca1377dd8bf6/userdata/shm major:0 minor:361 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/eec173871e025d96dcca044b8c81c7ea13f88767e45c84536a413a8200904cb6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/eec173871e025d96dcca044b8c81c7ea13f88767e45c84536a413a8200904cb6/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f0b82694ec3aac43bcc24ebe1a24a36e89559b298ffaf2e97d54915e766ae881/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f0b82694ec3aac43bcc24ebe1a24a36e89559b298ffaf2e97d54915e766ae881/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f7798ffabad8992f732acbb9e2ba43f0912c2138a726a6f7121e020da98ef2e3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f7798ffabad8992f732acbb9e2ba43f0912c2138a726a6f7121e020da98ef2e3/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fd70697a3b50239e6aaee4da49932fef768d4281dd5434ba17917dce9853f20e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fd70697a3b50239e6aaee4da49932fef768d4281dd5434ba17917dce9853f20e/userdata/shm major:0 minor:478 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/063cbdd6-3453-4a82-9532-6a846ad94f0e/volumes/kubernetes.io~projected/kube-api-access-m7vnf:{mountpoint:/var/lib/kubelet/pods/063cbdd6-3453-4a82-9532-6a846ad94f0e/volumes/kubernetes.io~projected/kube-api-access-m7vnf major:0 minor:272 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/063cbdd6-3453-4a82-9532-6a846ad94f0e/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/063cbdd6-3453-4a82-9532-6a846ad94f0e/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:268 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/063cbdd6-3453-4a82-9532-6a846ad94f0e/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/063cbdd6-3453-4a82-9532-6a846ad94f0e/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:271 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ca4d390-4036-4689-8ecd-d13b149ff6ba/volumes/kubernetes.io~projected/kube-api-access-tjkkg:{mountpoint:/var/lib/kubelet/pods/0ca4d390-4036-4689-8ecd-d13b149ff6ba/volumes/kubernetes.io~projected/kube-api-access-tjkkg major:0 minor:352 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ca4d390-4036-4689-8ecd-d13b149ff6ba/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/0ca4d390-4036-4689-8ecd-d13b149ff6ba/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:351 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2cac4841-e958-412a-b876-212f39aa120f/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/2cac4841-e958-412a-b876-212f39aa120f/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2cac4841-e958-412a-b876-212f39aa120f/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/2cac4841-e958-412a-b876-212f39aa120f/volumes/kubernetes.io~empty-dir/tmp major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2cac4841-e958-412a-b876-212f39aa120f/volumes/kubernetes.io~projected/kube-api-access-r5plx:{mountpoint:/var/lib/kubelet/pods/2cac4841-e958-412a-b876-212f39aa120f/volumes/kubernetes.io~projected/kube-api-access-r5plx major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:465 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/375e75d1-5a8d-4595-8e6b-509edbe45c2d/volumes/kubernetes.io~projected/kube-api-access-kj472:{mountpoint:/var/lib/kubelet/pods/375e75d1-5a8d-4595-8e6b-509edbe45c2d/volumes/kubernetes.io~projected/kube-api-access-kj472 major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3d5f797e-c46a-47fd-9a80-570a83b355ff/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/3d5f797e-c46a-47fd-9a80-570a83b355ff/volumes/kubernetes.io~secret/agent-certs major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/52746fc1-d7cc-449f-9f24-bfd4730769d2/volumes/kubernetes.io~projected/kube-api-access-qp52t:{mountpoint:/var/lib/kubelet/pods/52746fc1-d7cc-449f-9f24-bfd4730769d2/volumes/kubernetes.io~projected/kube-api-access-qp52t major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/586f9624-2168-4588-a01f-9cc483699682/volumes/kubernetes.io~projected/kube-api-access-n7vgf:{mountpoint:/var/lib/kubelet/pods/586f9624-2168-4588-a01f-9cc483699682/volumes/kubernetes.io~projected/kube-api-access-n7vgf major:0 minor:273 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/586f9624-2168-4588-a01f-9cc483699682/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/586f9624-2168-4588-a01f-9cc483699682/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/586f9624-2168-4588-a01f-9cc483699682/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/586f9624-2168-4588-a01f-9cc483699682/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/web-config/alertmanager/9 major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/web-config/config-reloader/6 major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~empty-dir/config-out major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~projected/kube-api-access-qph6d:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~projected/kube-api-access-qph6d major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~projected/tls-assets major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/config-volume major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/web-config major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volume-subpaths/web-config/config-reloader/2 major:0 minor:472 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:472 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volume-subpaths/web-config/prometheus/15 major:0 minor:472 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~empty-dir/config-out major:0 minor:474 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~projected/kube-api-access-wk7v4:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~projected/kube-api-access-wk7v4 major:0 minor:482 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~projected/tls-assets major:0 minor:476 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/config major:0 minor:469 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:467 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:477 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:475 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:473 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:471 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:468 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:470 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/web-config major:0 minor:472 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~projected/kube-api-access-jhffg:{mountpoint:/var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~projected/kube-api-access-jhffg major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:355 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46/volumes/kubernetes.io~projected/kube-api-access-2pttk:{mountpoint:/var/lib/kubelet/pods/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46/volumes/kubernetes.io~projected/kube-api-access-2pttk major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/81010882-395a-4762-b410-527c640e91ed/volumes/kubernetes.io~projected/kube-api-access-6bwv6:{mountpoint:/var/lib/kubelet/pods/81010882-395a-4762-b410-527c640e91ed/volumes/kubernetes.io~projected/kube-api-access-6bwv6 major:0 minor:466 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86595af1-257c-481b-8896-7b79fef64d5c/volumes/kubernetes.io~projected/kube-api-access-8gh5n:{mountpoint:/var/lib/kubelet/pods/86595af1-257c-481b-8896-7b79fef64d5c/volumes/kubernetes.io~projected/kube-api-access-8gh5n major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c8a6569-544e-4574-a9f2-0b5396a40984/volumes/kubernetes.io~projected/kube-api-access-4dstt:{mountpoint:/var/lib/kubelet/pods/8c8a6569-544e-4574-a9f2-0b5396a40984/volumes/kubernetes.io~projected/kube-api-access-4dstt major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c8a6569-544e-4574-a9f2-0b5396a40984/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/8c8a6569-544e-4574-a9f2-0b5396a40984/volumes/kubernetes.io~secret/metrics-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/967c1b48-0633-4580-8075-ea41321e866b/volumes/kubernetes.io~projected/kube-api-access-nbxc8:{mountpoint:/var/lib/kubelet/pods/967c1b48-0633-4580-8075-ea41321e866b/volumes/kubernetes.io~projected/kube-api-access-nbxc8 major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/967c1b48-0633-4580-8075-ea41321e866b/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/967c1b48-0633-4580-8075-ea41321e866b/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/967c1b48-0633-4580-8075-ea41321e866b/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/967c1b48-0633-4580-8075-ea41321e866b/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41/volumes/kubernetes.io~projected/kube-api-access-rkjjx:{mountpoint:/var/lib/kubelet/pods/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41/volumes/kubernetes.io~projected/kube-api-access-rkjjx major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4f2cbed-435d-41ed-a904-aab4c3dd4559/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/a4f2cbed-435d-41ed-a904-aab4c3dd4559/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4f2cbed-435d-41ed-a904-aab4c3dd4559/volumes/kubernetes.io~projected/kube-api-access-zx6n9:{mountpoint:/var/lib/kubelet/pods/a4f2cbed-435d-41ed-a904-aab4c3dd4559/volumes/kubernetes.io~projected/kube-api-access-zx6n9 major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4f2cbed-435d-41ed-a904-aab4c3dd4559/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/a4f2cbed-435d-41ed-a904-aab4c3dd4559/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7fa839e-ab2c-493b-b53a-79e769aa7d4a/volumes/kubernetes.io~projected/kube-api-access-xfz4r:{mountpoint:/var/lib/kubelet/pods/a7fa839e-ab2c-493b-b53a-79e769aa7d4a/volumes/kubernetes.io~projected/kube-api-access-xfz4r major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4/volumes/kubernetes.io~projected/kube-api-access-fgdcb:{mountpoint:/var/lib/kubelet/pods/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4/volumes/kubernetes.io~projected/kube-api-access-fgdcb major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c4e772a6-140b-4d72-873d-ac43b9b2f0a3/volumes/kubernetes.io~projected/kube-api-access-jm7qf:{mountpoint:/var/lib/kubelet/pods/c4e772a6-140b-4d72-873d-ac43b9b2f0a3/volumes/kubernetes.io~projected/kube-api-access-jm7qf major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c4e772a6-140b-4d72-873d-ac43b9b2f0a3/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/c4e772a6-140b-4d72-873d-ac43b9b2f0a3/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:264 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c4e772a6-140b-4d72-873d-ac43b9b2f0a3/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/c4e772a6-140b-4d72-873d-ac43b9b2f0a3/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~projected/kube-api-access-hcrpv:{mountpoint:/var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~projected/kube-api-access-hcrpv major:0 minor:369 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:367 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:368 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:365 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:366 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~projected/kube-api-access-brbm2:{mountpoint:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~projected/kube-api-access-brbm2 major:0 minor:346 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:344 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:343 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:341 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526/volumes/kubernetes.io~projected/kube-api-access-8mr4s:{mountpoint:/var/lib/kubelet/pods/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526/volumes/kubernetes.io~projected/kube-api-access-8mr4s major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526/volumes/kubernetes.io~secret/cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24/volumes/kubernetes.io~projected/kube-api-access-8lxqm:{mountpoint:/var/lib/kubelet/pods/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24/volumes/kubernetes.io~projected/kube-api-access-8lxqm major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24/volumes/kubernetes.io~secret/metrics-certs major:0 minor:461 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/c80cdcf7e003ce35682010041092106ba764094559e718e70ff5f797d6827af1/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/17f3b82880cca76bc3ee6049a05a2e12139fd82a16862976aa780800ac573af2/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/c4dbaad9b77695f9e67cef5167b9a341b8c25b177e7aac6b7b162b9f66ef6c8e/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-108:{mountpoint:/var/lib/containers/storage/overlay/24e9d2b05d194f1e92e895ba29d45428c8cf50aee5f624bdbe0c65910ca32539/merged major:0 minor:108 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/7a8f4e23a23647c3facd5649063a97cb3d3c5d5b74ff632bb2e714454bef3bf9/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/1af156ddc875cad5d99f98ece05decd8f198cd995d93d842d472baf2b13063ec/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/233d3edf1f715ea7e78490df4155066469bdcedf94c56d2aa435fef08dd83ea7/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/7c5d2238bec1604255bfecd8d1bfe62a61c05c9ed0bab72477aef90b8614b620/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/d1520cc9691ee5de7c66bbef424a7979bee6183db62d4495fd9b0f19d513f437/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/08b3d37d67746231830bda974db7abb9b1514c0f22a326f92774feefd01e4acf/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-141:{mountpoint:/var/lib/containers/storage/overlay/999b7dead09bdb5531d5fa03c424354e478db4f0995d592d7791bb2d97434a61/merged major:0 minor:141 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/8657d71d73b5fc8e56d4d002babc0d4c8aadde0785cc997819dcd472616e678a/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/482d5b3f28ce5e8da9d1f918050b820476f069f0e581b0adecc7b2eeaf346f42/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/ed10b48851a31f7e24de165d536114a34b9e65b2695702279b86c110b8fa9255/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/be3459baaa33750560d307cd298d014bc20e53c119b0d993be11cca847f05e3d/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/5f55b44cc23a4f1815760a867ea2f6fb98803bbc7d6e98bdc36d6d07911f37e2/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/3250769e95d9ed90c8cec061f05f096f1e7b2dead6247a65d933482c78af1780/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/95282ebeba3f1ecc2ba4381b18d8b4f3c11fe16870efdb9e9d96835f0e03729e/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/fb4dcd1dc99a80671688e647797ee6107fca6d55964debda0684f4641b495322/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/ab284196986ced1599d86215dd668877f5a42e099391aed548a5e0d3a5695535/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/f7478426da13cd24fbf8a580e88644f2eac4142171c38f87562416464b163679/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/416f86c18c3f0095888bf4677a408d5346cc4cfa8e0cc47fcc365dd62e4d1c53/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/5e9709dfd9dff08ad37a2a00ed540ea579a3f69e5556eb8c3c4ecc436669cdac/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/790e3ee1fe47e1e837bd27ea3141a5bf15fb11e9b3c2c805727ae81974db0daa/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/34773b15bca40d8d095769b3ac3da298f9b7ffe2c1ab9e09546fbe674e26e625/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/d48ba9cce73cd95d102dc86bc4afcd833b46d5a868813fe43647e504c90f98e7/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/f6e449d5d7bb3f8a8e7911abdc5c734bed047c9b8286c5864470ef8837b49ea5/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-232:{mountpoint:/var/lib/containers/storage/overlay/7cc1f0267a0f4ae564a2ec96559761e35f7606639cbe22649163b2c0daea41b7/merged major:0 minor:232 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/b143d3f0c3fda977bc7291d95882fa78aef9f6edac567841646622921cd96b91/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-243:{mountpoint:/var/lib/containers/storage/overlay/e3873046d7df34dbba37502195a5ecb02c526b5ed3eb17855b6dc4873df28d4d/merged major:0 minor:243 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/a5ee8a55a3b5049131153da77c424b83388c46233f07e2261aef52d33ffff48a/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/3160fa2a36e6966b8063b62528847b8f729635aa7341993da5cc5472509c7f4b/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/9dd76e705473b66f1fde61d9520ee51125791dcb21561898c86ad7ade67a3cf1/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/7c1ea227af90c0084c877eaacbf5a6ee1a4532424399f45f552c47c28bd2979d/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/d6342e2e70406ed22e9d90414dd44b75f1b3ec0eb22945a63f3600265fda7185/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/b8915c429e8afa00032c9da4465b51afb7da7dd9089eaac418b839e15a454db8/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-290:{mountpoint:/var/lib/containers/storage/overlay/6851ce7bcd7aa6142b66970c830370f849a0db7bd97c76c185281e8c1fc7a4ce/merged major:0 minor:290 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/8be9ef6a02284be1b2ee9e626e3935ccba76a3ae3ae2e18ff557cea7a9293d9f/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/28aaeae74504ff06c986a450589acd92db0cea88d43ed445a4edbbff310f500a/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-314:{mountpoint:/var/lib/containers/storage/overlay/32b80ec3bcec67e56a6bac9f29287add42f2ca08cd684594b6ab7eeee9d91932/merged major:0 minor:314 fsType:overlay blockSize:0} overlay_0-320:{mountpoint:/var/lib/containers/storage/overlay/8dde36ac0396f8812173f1c58c19edc88cd1875e7f5ccb1e86122eeb5989187c/merged major:0 minor:320 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/4a4fc8da060284380159dbd5f121f86fa8b02bc8880294695e55db91fc8e597e/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-326:{mountpoint:/var/lib/containers/storage/overlay/c7b0f9ec42e2d9e4d6332308cfdb39dd8c0238f37055f9e2017dcd925ca03d69/merged major:0 minor:326 fsType:overlay blockSize:0} overlay_0-331:{mountpoint:/var/lib/containers/storage/overlay/acdae8ba91c5446ac85652f3bd54e548c9c51392d9ff24a5e35f24b1bf38fa1a/merged major:0 minor:331 fsType:overlay blockSize:0} overlay_0-349:{mountpoint:/var/lib/containers/storage/overlay/2a27e6920796e4e3db8d2b867fb5f5cd8cbc482dbd840e1750168d12214c2347/merged major:0 minor:349 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/103779478b9e29afbeb40b6a9f68fc303c8ba2bff1b8d29668eb4497a7c2db5a/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/4faac80dadd7e864f3b3a7c314a05491b4023f22b05b855393b4bda46df3b42c/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-372:{mountpoint:/var/lib/containers/storage/overlay/486a675afe40318260e5321afe081cb1a317fc94bae50dcfc2c49a2b72682baf/merged major:0 minor:372 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/7b3c6c767a3075a8e2a89c415e3f2f115064814e216d57629b6c3c4b2d0d7a70/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/cc7c57282b8755bfdd18afd73f6e4af23ab570c494a11dc9a90cb0d2f0cf5353/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-382:{mountpoint:/var/lib/containers/storage/overlay/e0e2042c4a008bd887e952a6e72f2f93ad1ed552b967815b7efced8196c96294/merged major:0 minor:382 fsType:overlay blockSize:0} overlay_0-387:{mountpoint:/var/lib/containers/storage/overlay/7ed2612748362df662d0af6a6571b6e2d83233490077911aa5823643cb53448f/merged major:0 minor:387 fsType:overlay blockSize:0} overlay_0-392:{mountpoint:/var/lib/containers/storage/overlay/c9a378b81d88947febbc5fd9187749ee82682f4d767271f4fcd1958903864c53/merged major:0 minor:392 fsType:overlay blockSize:0} overlay_0-397:{mountpoint:/var/lib/containers/storage/overlay/d0e3f6378303ed4040d256f94eac88c184816b4bb223095ded0eb654578ed551/merged major:0 minor:397 fsType:overlay blockSize:0} overlay_0-402:{mountpoint:/var/lib/containers/storage/overlay/a755269009d8e599bddd490aacb9a670d509c9e75d0d05d7145103923b33db89/merged major:0 minor:402 fsType:overlay blockSize:0} overlay_0-409:{mountpoint:/var/lib/containers/storage/overlay/0aeca5c05b272a3061e7084fe3b8ff0eda5c0c879c0c66d43a69891b3ca3e3c2/merged major:0 minor:409 fsType:overlay blockSize:0} overlay_0-413:{mountpoint:/var/lib/containers/storage/overlay/8a926bd923392a38be509714c118dd04da6a9612fb243e708d4db4892571dfcf/merged major:0 minor:413 fsType:overlay blockSize:0} overlay_0-419:{mountpoint:/var/lib/containers/storage/overlay/fbc09f350b82a5fe24b5ec85ad2d04c8702effeababe5a87913fe7df98fc3680/merged major:0 minor:419 fsType:overlay blockSize:0} overlay_0-424:{mountpoint:/var/lib/containers/storage/overlay/478b9fef2b713066ca9a02a9e0cbddd1a2415241ab5df7039ce799b9a7f634cb/merged major:0 minor:424 fsType:overlay blockSize:0} overlay_0-430:{mountpoint:/var/lib/containers/storage/overlay/ced2a9cdc58d66769ccefaf8db20ea554f72b61c8f2932113b8afbfbb75131d2/merged major:0 minor:430 fsType:overlay blockSize:0} overlay_0-435:{mountpoint:/var/lib/containers/storage/overlay/d643b6b142dd34c3a790a74b488cc50d004ea7c851054ef6e89ab1261253655f/merged major:0 minor:435 fsType:overlay blockSize:0} overlay_0-440:{mountpoint:/var/lib/containers/storage/overlay/5d3040a2dc61d89fa21198461b7357a882fb93c2bd0660ae27449a88f7679062/merged major:0 minor:440 fsType:overlay blockSize:0} overlay_0-445:{mountpoint:/var/lib/containers/storage/overlay/6c86713ccaf361e9052fdceb72c69adc84e94a47de48669e537ff864e307c10f/merged major:0 minor:445 fsType:overlay blockSize:0} overlay_0-450:{mountpoint:/var/lib/containers/storage/overlay/bef342e5a55b88d491ef1c89cb323704dfb23b75fcf15297d4b07e35fd6c6b53/merged major:0 minor:450 fsType:overlay blockSize:0} overlay_0-456:{mountpoint:/var/lib/containers/storage/overlay/c30b5d24fce664c4fa25eeec57a4bd6962f01bf2e5cfadd195da6655b9574bfd/merged major:0 minor:456 fsType:overlay blockSize:0} overlay_0-487:{mountpoint:/var/lib/containers/storage/overlay/82a2864f1e520b1558db5d46ba619a1621d95dd3b6d5936160dc6dec16c2db32/merged major:0 minor:487 fsType:overlay blockSize:0} overlay_0-489:{mountpoint:/var/lib/containers/storage/overlay/045dadb94b7afa27b29d8576773a2818ba2e6c3b3cb4b2451dc3be1fe4e2b034/merged major:0 minor:489 fsType:overlay blockSize:0} overlay_0-491:{mountpoint:/var/lib/containers/storage/overlay/4a8efae76484e141a1aaa6e8c94c51d6986369e4e8319cca215eb8d4650beee2/merged major:0 minor:491 fsType:overlay blockSize:0} overlay_0-493:{mountpoint:/var/lib/containers/storage/overlay/1377ed226be9476c32a69db4787f40166e905aeab614b285e4e5be0bb71385a1/merged major:0 minor:493 fsType:overlay blockSize:0} overlay_0-495:{mountpoint:/var/lib/containers/storage/overlay/db4c9b308c4aefc8973a5bbc5c4e6f216834be5716ca97c458a5151c9e568e18/merged major:0 minor:495 fsType:overlay blockSize:0} overlay_0-497:{mountpoint:/var/lib/containers/storage/overlay/c3110b9af9e52220241b3cdb9f5e4c1b064e0558a1f076648160302c3cccd40b/merged major:0 minor:497 fsType:overlay blockSize:0} overlay_0-503:{mountpoint:/var/lib/containers/storage/overlay/fa656f0ec5180af69e5cbec743879f1a7aba10711afaed2b51f59069d1520c0b/merged major:0 minor:503 fsType:overlay blockSize:0} overlay_0-508:{mountpoint:/var/lib/containers/storage/overlay/56869d570c7854bc6feb90575b0330afa94933c345c91e5fea418abebbfcb706/merged major:0 minor:508 fsType:overlay blockSize:0} overlay_0-514:{mountpoint:/var/lib/containers/storage/overlay/776555fd66d93caf962b27b5d0f1bf0cc0f978a09d7a246c7a868eab326cbed8/merged major:0 minor:514 fsType:overlay blockSize:0} overlay_0-520:{mountpoint:/var/lib/containers/storage/overlay/cf09ed3dda58313697d51842d69f130b5eaa84423abb5c6258e635989ad24b4f/merged major:0 minor:520 fsType:overlay blockSize:0} overlay_0-525:{mountpoint:/var/lib/containers/storage/overlay/757b6d7a7907b0afbf45fe108899a27cc90c69bf440e57047909d25477cf79de/merged major:0 minor:525 fsType:overlay blockSize:0} overlay_0-530:{mountpoint:/var/lib/containers/storage/overlay/ec776e1f056b80e6d85a0fc01099f40490bab8235de4127ea1781f66fa86bda3/merged major:0 minor:530 fsType:overlay blockSize:0} overlay_0-535:{mountpoint:/var/lib/containers/storage/overlay/954218308c154bd57b9cb4af289b1fe9074553bf664efa8c40f4946e2b24bcbd/merged major:0 minor:535 fsType:overlay blockSize:0} overlay_0-540:{mountpoint:/var/lib/containers/storage/overlay/8f647b22be87cde4294e73cc38bb669394b4fc87e0bc2e74e04b896b4bc01cda/merged major:0 minor:540 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/d847e17c40d62fe6e06ed9263c7b1af0a7c6de375b9717448171d8eac9749c0e/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/e143f49989e2f062948aec5f9d0de6a1c7ef6904058373f4519464f43db6bbcd/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/f7204e88ee31e8b2dc262a75abb328260588900306c6c093815f779094cbcf33/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/7944ddca83c4118ecb7848ea4652c170c6e3b76ffb588ad9cfed901601378474/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/36554635013be88324e55abc66ff10cff7a67a9c44612956928c8dbe1cbd97db/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/91e71e904e7f1676bd9df88ce752243b47bc561269b953833e2c335dcbc9a1e8/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/125fa9ac98928ab3199e5b4a7a97203476891be524abdb873a7ef578a71ebcf9/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/296128695cb7affd7a6a8ff70881c7c1a0025afd2aa4a89380ab7ed1ad3332f2/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/50ecae8c917e0b114031809fd12071037bd2ffbe8be1a6c7ef06e35be19057ff/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/bc6f1f905af0b666021222fcccf3d9a714f868154464e934c16404943865f624/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 19:25:37.525869 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.524877    6015 manager.go:217] Machine: {Timestamp:2026-10-30 19:25:37.524387067 +0000 UTC m=+0.067194322 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3130305 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fc68cf2c9ef9d23bcfc968b1abd9c SystemUUID:ec2fc68c-f2c9-ef9d-23bc-fc968b1abd9c BootID:de90163d-0aeb-4223-be56-bc6509ac43f4 Filesystems:[{Device:/var/lib/kubelet/pods/586f9624-2168-4588-a01f-9cc483699682/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:270 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:297 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-450 DeviceMajor:0 DeviceMinor:450 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:468 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/3d5f797e-c46a-47fd-9a80-570a83b355ff/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:47 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/52746fc1-d7cc-449f-9f24-bfd4730769d2/volumes/kubernetes.io~projected/kube-api-access-qp52t DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/063cbdd6-3453-4a82-9532-6a846ad94f0e/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:268 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:366 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/131a3e04a2258e46f03443805d13d12f8b313b8ecbb506053b0483bddfbf5c20/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/39439d7ae5b65413793c02a149dc8f0214fe6f657e1670648fde1cd780207426/userdata/shm DeviceMajor:0 DeviceMinor:83 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/eec173871e025d96dcca044b8c81c7ea13f88767e45c84536a413a8200904cb6/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c4e772a6-140b-4d72-873d-ac43b9b2f0a3/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:259 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:342 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:345 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:357 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-402 DeviceMajor:0 DeviceMinor:402 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:303 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-382 DeviceMajor:0 DeviceMinor:382 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-419 DeviceMajor:0 DeviceMinor:419 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/86595af1-257c-481b-8896-7b79fef64d5c/volumes/kubernetes.io~projected/kube-api-access-8gh5n DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8c8a6569-544e-4574-a9f2-0b5396a40984/volumes/kubernetes.io~projected/kube-api-access-4dstt DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:340 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:341 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-435 DeviceMajor:0 DeviceMinor:435 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/46436299dc90e3270dfe9b2afc376efc56db5607e6027d6121e8e7994d44838f/userdata/shm DeviceMajor:0 DeviceMinor:276 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:299 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:467 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:473 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/23e4c7532d922897b2cfe523c247394c52db9b9db6e18256174b24aa87fd3c3f/userdata/shm DeviceMajor:0 DeviceMinor:480 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3420a6c033bb5ef447aba3ebdfa6d1c0d8e9aa128be3ec2da9c93073485347c2/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/967c1b48-0633-4580-8075-ea41321e866b/volumes/kubernetes.io~projected/kube-api-access-nbxc8 DeviceMajor:0 DeviceMinor:225 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:471 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:472 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-497 DeviceMajor:0 DeviceMinor:497 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/a4f2cbed-435d-41ed-a904-aab4c3dd4559/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c4e772a6-140b-4d72-873d-ac43b9b2f0a3/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:264 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-430 DeviceMajor:0 DeviceMinor:430 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:474 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-493 DeviceMajor:0 DeviceMinor:493 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:472 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/06921b140df4761b1fd8ee437587c6be8552aee4ef261ce2f59141f92b2bc69d/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-243 DeviceMajor:0 DeviceMinor:243 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~projected/kube-api-access-brbm2 DeviceMajor:0 DeviceMinor:346 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0ca4d390-4036-4689-8ecd-d13b149ff6ba/volumes/kubernetes.io~projected/kube-api-access-tjkkg DeviceMajor:0 DeviceMinor:352 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:356 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:465 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-489 DeviceMajor:0 DeviceMinor:489 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-535 DeviceMajor:0 DeviceMinor:535 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d769b475fa5604f0de0920b2bf1b7440ad040f337324ec013d53ca1377dd8bf6/userdata/shm DeviceMajor:0 DeviceMinor:361 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-413 DeviceMajor:0 DeviceMinor:413 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-525 DeviceMajor:0 DeviceMinor:525 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4/volumes/kubernetes.io~projected/kube-api-access-fgdcb DeviceMajor:0 DeviceMinor:54 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46/volumes/kubernetes.io~projected/kube-api-access-2pttk DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:292 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:355 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2cac4841-e958-412a-b876-212f39aa120f/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:50 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:470 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-540 DeviceMajor:0 DeviceMinor:540 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2cac4841-e958-412a-b876-212f39aa120f/volumes/kubernetes.io~projected/kube-api-access-r5plx DeviceMajor:0 DeviceMinor:51 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526/volumes/kubernetes.io~projected/kube-api-access-8mr4s DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-320 DeviceMajor:0 DeviceMinor:320 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-372 DeviceMajor:0 DeviceMinor:372 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-487 DeviceMajor:0 DeviceMinor:487 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:472 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/81010882-395a-4762-b410-527c640e91ed/volumes/kubernetes.io~projected/kube-api-access-6bwv6 DeviceMajor:0 DeviceMinor:466 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a7fa839e-ab2c-493b-b53a-79e769aa7d4a/volumes/kubernetes.io~projected/kube-api-access-xfz4r DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a4f2cbed-435d-41ed-a904-aab4c3dd4559/volumes/kubernetes.io~projected/kube-api-access-zx6n9 DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c4e772a6-140b-4d72-873d-ac43b9b2f0a3/volumes/kubernetes.io~projected/kube-api-access-jm7qf DeviceMajor:0 DeviceMinor:265 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/50e1279c5e004ce798d73a50162d234169f4b3032efa0ada158564816f77b965/userdata/shm DeviceMajor:0 DeviceMinor:266 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/69657bb8-0d16-4aeb-9388-5184569b0114/volumes/kubernetes.io~projected/kube-api-access-jhffg DeviceMajor:0 DeviceMinor:358 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f0b82694ec3aac43bcc24ebe1a24a36e89559b298ffaf2e97d54915e766ae881/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-108 DeviceMajor:0 DeviceMinor:108 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41/volumes/kubernetes.io~projected/kube-api-access-rkjjx DeviceMajor:0 DeviceMinor:204 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/063cbdd6-3453-4a82-9532-6a846ad94f0e/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:271 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/586f9624-2168-4588-a01f-9cc483699682/volumes/kubernetes.io~projected/kube-api-access-n7vgf DeviceMajor:0 DeviceMinor:273 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~projected/kube-api-access-qph6d DeviceMajor:0 DeviceMinor:310 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:344 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:477 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-491 DeviceMajor:0 DeviceMinor:491 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8834f4b1de471ce7857364be8abbc3374fd6633b0dcc858b9521138903fd6967/userdata/shm DeviceMajor:0 DeviceMinor:347 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:475 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~projected/kube-api-access-wk7v4 DeviceMajor:0 DeviceMinor:482 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/375e75d1-5a8d-4595-8e6b-509edbe45c2d/volumes/kubernetes.io~projected/kube-api-access-kj472 DeviceMajor:0 DeviceMinor:53 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:296 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:300 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-456 DeviceMajor:0 DeviceMinor:456 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-141 DeviceMajor:0 DeviceMinor:141 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:203 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/30f0faf425e8933a9257bc2a808d2cb8d79b0407de61f77b0f128a8236be7f54/userdata/shm DeviceMajor:0 DeviceMinor:274 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:301 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-387 DeviceMajor:0 DeviceMinor:387 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0e7c1ce9b0deea5a68e71f3de90602e8e7a1d984d7374b619b38aea279c07338/userdata/shm DeviceMajor:0 DeviceMinor:485 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2cac4841-e958-412a-b876-212f39aa120f/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:48 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a4f2cbed-435d-41ed-a904-aab4c3dd4559/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:49 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-232 DeviceMajor:0 DeviceMinor:232 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-445 DeviceMajor:0 DeviceMinor:445 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-530 DeviceMajor:0 DeviceMinor:530 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-290 DeviceMajor:0 DeviceMinor:290 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/539c17aa278d6e8e3ffbc588b0d4339a55f2197d41a9ce23cd192f2529b493c2/userdata/shm DeviceMajor:0 DeviceMinor:306 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d78689c3-56b1-481c-9ef7-bf81b9a9679e/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:343 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1505bdef70cf34df8f028241df12b5d8c4de801d69baea3d53370a5dae36047e/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a69ae157d81529b9fb51b76dc641a5c199cd00be6c19e35f75e9238a96927d3b/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/967c1b48-0633-4580-8075-ea41321e866b/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:219 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:302 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:303 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0ca4d390-4036-4689-8ecd-d13b149ff6ba/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:351 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:472 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f7798ffabad8992f732acbb9e2ba43f0912c2138a726a6f7121e020da98ef2e3/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/967c1b48-0633-4580-8075-ea41321e866b/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:224 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/063cbdd6-3453-4a82-9532-6a846ad94f0e/volumes/kubernetes.io~projected/kube-api-access-m7vnf DeviceMajor:0 DeviceMinor:272 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:298 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:368 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6dd0e75a833b25ae936a9b0edf3f4ea5e1dd8c92d95676f7cb578bb7fe8a2514/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-326 DeviceMajor:0 DeviceMinor:326 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0a2c3e34824042a5d977ef79e27e545609449943c1251b38756f6186d0c540d0/userdata/shm DeviceMajor:0 DeviceMinor:353 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:367 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~projected/kube-api-access-hcrpv DeviceMajor:0 DeviceMinor:369 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8b5efa79e520049c2f23a7aa737ae2d169ba8be7fa2766dacd02381ffe2e6667/userdata/shm DeviceMajor:0 DeviceMinor:370 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8c8a6569-544e-4574-a9f2-0b5396a40984/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8ca97d579ff24a1a53a1d57327e8dec74ee34d0b88000382c38598ab25bdf8eb/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ac018828065099ab71a4aa616c89233e5b18ac7e177abefec61071267058dc9e/userdata/shm DeviceMajor:0 DeviceMinor:226 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-314 DeviceMajor:0 DeviceMinor:314 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-392 DeviceMajor:0 DeviceMinor:392 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fd70697a3b50239e6aaee4da49932fef768d4281dd5434ba17917dce9853f20e/userdata/shm DeviceMajor:0 DeviceMinor:478 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-514 DeviceMajor:0 DeviceMinor:514 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:292 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-397 DeviceMajor:0 DeviceMinor:397 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-409 DeviceMajor:0 DeviceMinor:409 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-440 DeviceMajor:0 DeviceMinor:440 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:461 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:476 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5b868cbfc187e337b3b43a80e9eeb3d71b885dbcf9f37e65cf435a701400589d/userdata/shm DeviceMajor:0 DeviceMinor:483 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8039ca1d77eb06f2e90d415c2b9d3d2ae0fc10980530d679cd3fd54c2ac13e3c/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2d854e8a3f11d48b9539a131d049f5005297526af3e6001acb08199214e992b0/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-424 DeviceMajor:0 DeviceMinor:424 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-503 DeviceMajor:0 DeviceMinor:503 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-520 DeviceMajor:0 DeviceMinor:520 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cc905dc2-23e8-4237-8874-f2e9d8ae50a4/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:365 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:292 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:469 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-508 DeviceMajor:0 DeviceMinor:508 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-331 DeviceMajor:0 DeviceMinor:331 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-349 DeviceMajor:0 DeviceMinor:349 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:292 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-495 DeviceMajor:0 DeviceMinor:495 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24/volumes/kubernetes.io~projected/kube-api-access-8lxqm DeviceMajor:0 DeviceMinor:52 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/586f9624-2168-4588-a01f-9cc483699682/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:269 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0a2c3e34824042a MacAddress:66:2a:aa:e9:c0:33 Speed:10000 Mtu:8901} {Name:0e7c1ce9b0deea5 MacAddress:be:47:6f:2b:69:14 Speed:10000 Mtu:8901} {Name:23e4c7532d92289 MacAddress:0a:f1:80:8f:93:9f Speed:10000 Mtu:8901} {Name:30f0faf425e8933 MacAddress:22:bf:98:cf:29:61 Speed:10000 Mtu:8901} {Name:3420a6c033bb5ef MacAddress:2a:94:f6:52:b5:27 Speed:10000 Mtu:8901} {Name:50e1279c5e004ce MacAddress:fa:02:54:ad:b7:9b Speed:10000 Mtu:8901} {Name:539c17aa278d6e8 MacAddress:3a:e1:e1:d2:1c:da Speed:10000 Mtu:8901} {Name:5b868cbfc187e33 MacAddress:5e:6e:9d:58:60:51 Speed:10000 Mtu:8901} {Name:8834f4b1de471ce MacAddress:6a:8a:9b:36:20:06 Speed:10000 Mtu:8901} {Name:8b5efa79e520049 MacAddress:8e:b0:69:f5:b3:b6 Speed:10000 Mtu:8901} {Name:8ca97d579ff24a1 MacAddress:02:54:1f:04:b1:d4 Speed:10000 Mtu:8901} {Name:ac018828065099a MacAddress:92:cc:c8:80:82:25 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:cb:50:b5:d9 Speed:0 Mtu:9001} {Name:br-int MacAddress:32:06:5a:f5:5d:a3 Speed:0 Mtu:8901} {Name:d769b475fa5604f MacAddress:52:70:69:9b:90:00 Speed:10000 Mtu:8901} {Name:eec173871e025d9 MacAddress:56:01:e2:81:59:ff Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:cb:50:b5:d9 Speed:0 Mtu:9001} {Name:fd70697a3b50239 MacAddress:1a:a4:31:ca:64:a6 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:3e:b4:8d:b5:95:e4 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:d2:b7:50:ea:23:83 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 19:25:37.525869 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.525369    6015 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 19:25:37.525869 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.525417    6015 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 19:25:37.525869 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.525702    6015 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 19:25:37.526184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.525733    6015 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-34.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 19:25:37.526184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.525908    6015 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 19:25:37.526184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.525915    6015 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 19:25:37.526184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.525926    6015 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 19:25:37.526184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.525938    6015 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 19:25:37.526184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.526041    6015 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 19:25:37.526359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.526202    6015 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 19:25:37.526359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.526323    6015 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 19:25:37.526359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.526357    6015 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 19:25:37.526447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.526372    6015 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 19:25:37.526447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.526382    6015 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 19:25:37.526447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.526391    6015 kubelet.go:405] "Adding apiserver pod source"
Oct 30 19:25:37.526447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.526399    6015 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 19:25:37.527177 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.527160    6015 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 19:25:37.527177 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.527174    6015 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 19:25:37.527673 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.527658    6015 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 19:25:37.530732 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.530717    6015 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 19:25:37.530732 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.530731    6015 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 19:25:37.530928 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.530845    6015 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 19:25:37.531058 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531046    6015 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 19:25:37.531095 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531076    6015 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 19:25:37.531195 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531185    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 19:25:37.531225 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531205    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 19:25:37.531225 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531214    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 19:25:37.531225 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531222    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 19:25:37.531303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531227    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 19:25:37.531303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531233    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 19:25:37.531303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531239    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 19:25:37.531303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531244    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 19:25:37.531303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531250    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 19:25:37.531303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531256    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 19:25:37.531303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531269    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 19:25:37.531303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531278    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 19:25:37.531303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531304    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 19:25:37.531530 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.531311    6015 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 19:25:37.535003 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.534988    6015 server.go:1263] "Started kubelet"
Oct 30 19:25:37.535461 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.535083    6015 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 19:25:37.535461 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.535131    6015 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 19:25:37.535461 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.535228    6015 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 19:25:37.535664 ip-10-0-130-34 systemd[1]: Started Kubernetes Kubelet.
Oct 30 19:25:37.536187 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.535767    6015 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 19:25:37.537291 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.537266    6015 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 19:25:37.544891 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.544866    6015 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 19:25:37.545028 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.544904    6015 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 19:25:37.545028 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.544970    6015 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 19:19:26 +0000 UTC" deadline="2028-05-25 20:17:46.109940832 +0000 UTC"
Oct 30 19:25:37.545028 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.544998    6015 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13752h52m8.564945596s"
Oct 30 19:25:37.545192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.545081    6015 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 19:25:37.545192 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:37.545080    6015 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-34.us-west-2.compute.internal\" not found"
Oct 30 19:25:37.545192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.545090    6015 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 19:25:37.545192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.545190    6015 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 19:25:37.547525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.547496    6015 factory.go:55] Registering systemd factory
Oct 30 19:25:37.547525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.547524    6015 factory.go:223] Registration of the systemd container factory successfully
Oct 30 19:25:37.547830 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.547789    6015 factory.go:153] Registering CRI-O factory
Oct 30 19:25:37.547913 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.547836    6015 factory.go:223] Registration of the crio container factory successfully
Oct 30 19:25:37.547913 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.547905    6015 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 19:25:37.548013 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.547941    6015 factory.go:103] Registering Raw factory
Oct 30 19:25:37.548013 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.547987    6015 manager.go:1199] Started watching for new ooms in manager
Oct 30 19:25:37.548357 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548343    6015 manager.go:319] Starting recovery of all containers
Oct 30 19:25:37.548638 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548597    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4f2cbed-435d-41ed-a904-aab4c3dd4559" volumeName="kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-env-overrides" seLinuxMountContext=""
Oct 30 19:25:37.548711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548643    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24" volumeName="kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs" seLinuxMountContext=""
Oct 30 19:25:37.548711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548659    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 19:25:37.548711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548672    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7fa839e-ab2c-493b-b53a-79e769aa7d4a" volumeName="kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-daemon-config" seLinuxMountContext=""
Oct 30 19:25:37.548711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548696    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d5f797e-c46a-47fd-9a80-570a83b355ff" volumeName="kubernetes.io/configmap/3d5f797e-c46a-47fd-9a80-570a83b355ff-konnectivity-ca" seLinuxMountContext=""
Oct 30 19:25:37.548711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548707    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d78689c3-56b1-481c-9ef7-bf81b9a9679e" volumeName="kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-grpc-tls" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548718    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="375e75d1-5a8d-4595-8e6b-509edbe45c2d" volumeName="kubernetes.io/projected/375e75d1-5a8d-4595-8e6b-509edbe45c2d-kube-api-access-kj472" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548731    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-tls-assets" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548747    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36c3af0c-ac42-4a11-9fbd-ebc48700b9d2" volumeName="kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548773    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548785    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-db" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548797    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="063cbdd6-3453-4a82-9532-6a846ad94f0e" volumeName="kubernetes.io/projected/063cbdd6-3453-4a82-9532-6a846ad94f0e-kube-api-access-m7vnf" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548826    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="586f9624-2168-4588-a01f-9cc483699682" volumeName="kubernetes.io/projected/586f9624-2168-4588-a01f-9cc483699682-kube-api-access-n7vgf" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548840    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-cluster-tls-config" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548868    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69657bb8-0d16-4aeb-9388-5184569b0114" volumeName="kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548881    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="063cbdd6-3453-4a82-9532-6a846ad94f0e" volumeName="kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548893    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d5f797e-c46a-47fd-9a80-570a83b355ff" volumeName="kubernetes.io/secret/3d5f797e-c46a-47fd-9a80-570a83b355ff-agent-certs" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548904    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86595af1-257c-481b-8896-7b79fef64d5c" volumeName="kubernetes.io/configmap/86595af1-257c-481b-8896-7b79fef64d5c-iptables-alerter-script" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548917    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="967c1b48-0633-4580-8075-ea41321e866b" volumeName="kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-console-config" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548930    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d78689c3-56b1-481c-9ef7-bf81b9a9679e" volumeName="kubernetes.io/configmap/d78689c3-56b1-481c-9ef7-bf81b9a9679e-metrics-client-ca" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548942    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="52746fc1-d7cc-449f-9f24-bfd4730769d2" volumeName="kubernetes.io/configmap/52746fc1-d7cc-449f-9f24-bfd4730769d2-serviceca" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548954    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-metrics-client-certs" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548966    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4f2cbed-435d-41ed-a904-aab4c3dd4559" volumeName="kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-config" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548978    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4f2cbed-435d-41ed-a904-aab4c3dd4559" volumeName="kubernetes.io/secret/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 19:25:37.548991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.548991    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="063cbdd6-3453-4a82-9532-6a846ad94f0e" volumeName="kubernetes.io/empty-dir/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-textfile" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549004    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="586f9624-2168-4588-a01f-9cc483699682" volumeName="kubernetes.io/empty-dir/586f9624-2168-4588-a01f-9cc483699682-volume-directive-shadow" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549018    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549031    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69657bb8-0d16-4aeb-9388-5184569b0114" volumeName="kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-client-ca-bundle" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549048    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="063cbdd6-3453-4a82-9532-6a846ad94f0e" volumeName="kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-metrics-client-ca" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549059    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549073    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c8a6569-544e-4574-a9f2-0b5396a40984" volumeName="kubernetes.io/empty-dir/8c8a6569-544e-4574-a9f2-0b5396a40984-tmp-dir" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549088    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ca4d390-4036-4689-8ecd-d13b149ff6ba" volumeName="kubernetes.io/secret/0ca4d390-4036-4689-8ecd-d13b149ff6ba-monitoring-plugin-cert" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549100    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549112    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69657bb8-0d16-4aeb-9388-5184569b0114" volumeName="kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549123    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c8a6569-544e-4574-a9f2-0b5396a40984" volumeName="kubernetes.io/projected/8c8a6569-544e-4574-a9f2-0b5396a40984-kube-api-access-4dstt" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549134    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="586f9624-2168-4588-a01f-9cc483699682" volumeName="kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549145    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="967c1b48-0633-4580-8075-ea41321e866b" volumeName="kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-serving-cert" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549157    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4f2cbed-435d-41ed-a904-aab4c3dd4559" volumeName="kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549169    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc905dc2-23e8-4237-8874-f2e9d8ae50a4" volumeName="kubernetes.io/projected/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-kube-api-access-hcrpv" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549180    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526" volumeName="kubernetes.io/secret/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-cert" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549192    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2cac4841-e958-412a-b876-212f39aa120f" volumeName="kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-etc-tuned" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549205    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-kube-api-access-wk7v4" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549216    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d78689c3-56b1-481c-9ef7-bf81b9a9679e" volumeName="kubernetes.io/empty-dir/d78689c3-56b1-481c-9ef7-bf81b9a9679e-tmp" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549228    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d78689c3-56b1-481c-9ef7-bf81b9a9679e" volumeName="kubernetes.io/projected/d78689c3-56b1-481c-9ef7-bf81b9a9679e-kube-api-access-brbm2" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549241    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d78689c3-56b1-481c-9ef7-bf81b9a9679e" volumeName="kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549252    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2cac4841-e958-412a-b876-212f39aa120f" volumeName="kubernetes.io/projected/2cac4841-e958-412a-b876-212f39aa120f-kube-api-access-r5plx" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549267    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549281    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69657bb8-0d16-4aeb-9388-5184569b0114" volumeName="kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549294    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="967c1b48-0633-4580-8075-ea41321e866b" volumeName="kubernetes.io/projected/967c1b48-0633-4580-8075-ea41321e866b-kube-api-access-nbxc8" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549305    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc905dc2-23e8-4237-8874-f2e9d8ae50a4" volumeName="kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-federate-client-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549318    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549331    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549343    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-config" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549355    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ca4d390-4036-4689-8ecd-d13b149ff6ba" volumeName="kubernetes.io/projected/0ca4d390-4036-4689-8ecd-d13b149ff6ba-kube-api-access-tjkkg" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549367    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-out" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549379    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549402    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86595af1-257c-481b-8896-7b79fef64d5c" volumeName="kubernetes.io/projected/86595af1-257c-481b-8896-7b79fef64d5c-kube-api-access-8gh5n" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549414    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d78689c3-56b1-481c-9ef7-bf81b9a9679e" volumeName="kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549429    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2cac4841-e958-412a-b876-212f39aa120f" volumeName="kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-tmp" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549441    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-volume" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549454    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="967c1b48-0633-4580-8075-ea41321e866b" volumeName="kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-oauth-config" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549467    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c4e772a6-140b-4d72-873d-ac43b9b2f0a3" volumeName="kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549479    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24" volumeName="kubernetes.io/projected/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-kube-api-access-8lxqm" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549492    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="586f9624-2168-4588-a01f-9cc483699682" volumeName="kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549504    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549516    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-grpc-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549528    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="967c1b48-0633-4580-8075-ea41321e866b" volumeName="kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-oauth-serving-cert" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549539    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="967c1b48-0633-4580-8075-ea41321e866b" volumeName="kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549552    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4" volumeName="kubernetes.io/projected/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-kube-api-access-fgdcb" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549565    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="52746fc1-d7cc-449f-9f24-bfd4730769d2" volumeName="kubernetes.io/projected/52746fc1-d7cc-449f-9f24-bfd4730769d2-kube-api-access-qp52t" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549576    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69657bb8-0d16-4aeb-9388-5184569b0114" volumeName="kubernetes.io/empty-dir/69657bb8-0d16-4aeb-9388-5184569b0114-audit-log" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549588    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc905dc2-23e8-4237-8874-f2e9d8ae50a4" volumeName="kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-metrics-client-ca" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549599    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98b5e381-31e7-4ca3-a2f3-c0f59d34bd41" volumeName="kubernetes.io/secret/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549611    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="063cbdd6-3453-4a82-9532-6a846ad94f0e" volumeName="kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549623    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-kube-api-access-qph6d" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549636    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98b5e381-31e7-4ca3-a2f3-c0f59d34bd41" volumeName="kubernetes.io/configmap/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549647    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98b5e381-31e7-4ca3-a2f3-c0f59d34bd41" volumeName="kubernetes.io/empty-dir/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-data-volume" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549658    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="375e75d1-5a8d-4595-8e6b-509edbe45c2d" volumeName="kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549670    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98b5e381-31e7-4ca3-a2f3-c0f59d34bd41" volumeName="kubernetes.io/projected/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-api-access-rkjjx" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549684    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c4e772a6-140b-4d72-873d-ac43b9b2f0a3" volumeName="kubernetes.io/projected/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-kube-api-access-jm7qf" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549697    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc905dc2-23e8-4237-8874-f2e9d8ae50a4" volumeName="kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549709    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69657bb8-0d16-4aeb-9388-5184569b0114" volumeName="kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549719    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="78ba6c78-49c1-47e1-a0bd-4ae3f6784d46" volumeName="kubernetes.io/projected/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kube-api-access-2pttk" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549730    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7fa839e-ab2c-493b-b53a-79e769aa7d4a" volumeName="kubernetes.io/projected/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-kube-api-access-xfz4r" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549742    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c4e772a6-140b-4d72-873d-ac43b9b2f0a3" volumeName="kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549752    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526" volumeName="kubernetes.io/projected/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-kube-api-access-8mr4s" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549765    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549776    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549787    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c4e772a6-140b-4d72-873d-ac43b9b2f0a3" volumeName="kubernetes.io/configmap/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-metrics-client-ca" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549799    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc905dc2-23e8-4237-8874-f2e9d8ae50a4" volumeName="kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-client-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549834    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc905dc2-23e8-4237-8874-f2e9d8ae50a4" volumeName="kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549846    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d78689c3-56b1-481c-9ef7-bf81b9a9679e" volumeName="kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549859    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="375e75d1-5a8d-4595-8e6b-509edbe45c2d" volumeName="kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549873    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-tls-assets" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549886    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69657bb8-0d16-4aeb-9388-5184569b0114" volumeName="kubernetes.io/projected/69657bb8-0d16-4aeb-9388-5184569b0114-kube-api-access-jhffg" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549898    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="81010882-395a-4762-b410-527c640e91ed" volumeName="kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549910    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4" volumeName="kubernetes.io/empty-dir/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-tmp-dir" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549923    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d78689c3-56b1-481c-9ef7-bf81b9a9679e" volumeName="kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549967    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="375e75d1-5a8d-4595-8e6b-509edbe45c2d" volumeName="kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-binary-copy" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549979    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-web-config" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.549991    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550048    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-web-config" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550106    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="063cbdd6-3453-4a82-9532-6a846ad94f0e" volumeName="kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550118    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="586f9624-2168-4588-a01f-9cc483699682" volumeName="kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-metrics-client-ca" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550142    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550154    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d78689c3-56b1-481c-9ef7-bf81b9a9679e" volumeName="kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550165    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-metrics-client-ca" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550186    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550198    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550216    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c8a6569-544e-4574-a9f2-0b5396a40984" volumeName="kubernetes.io/secret/8c8a6569-544e-4574-a9f2-0b5396a40984-metrics-tls" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550260    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4f2cbed-435d-41ed-a904-aab4c3dd4559" volumeName="kubernetes.io/projected/a4f2cbed-435d-41ed-a904-aab4c3dd4559-kube-api-access-zx6n9" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550271    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc905dc2-23e8-4237-8874-f2e9d8ae50a4" volumeName="kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550355    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="586f9624-2168-4588-a01f-9cc483699682" volumeName="kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550379    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="605f1852-7ec7-4c02-938a-6d654d7e70bc" volumeName="kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-config-out" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550391    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c8a6569-544e-4574-a9f2-0b5396a40984" volumeName="kubernetes.io/configmap/8c8a6569-544e-4574-a9f2-0b5396a40984-config-volume" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550401    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-main-db" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550423    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" volumeName="kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550434    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7fa839e-ab2c-493b-b53a-79e769aa7d4a" volumeName="kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cni-binary-copy" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550458    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc905dc2-23e8-4237-8874-f2e9d8ae50a4" volumeName="kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550479    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="967c1b48-0633-4580-8075-ea41321e866b" volumeName="kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-service-ca" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550491    6015 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="967c1b48-0633-4580-8075-ea41321e866b" volumeName="kubernetes.io/empty-dir/967c1b48-0633-4580-8075-ea41321e866b-tmp" seLinuxMountContext=""
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550502    6015 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 19:25:37.550654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.550510    6015 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 19:25:37.574285 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.574071    6015 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 19:25:37.576663 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.576638    6015 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 19:25:37.576663 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.576662    6015 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 19:25:37.576955 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.576682    6015 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 19:25:37.576955 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:37.576723    6015 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 19:25:37.597743 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.597712    6015 generic.go:356] "Generic (PLEG): container finished" podID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerID="30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56" exitCode=0
Oct 30 19:25:37.613912 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.613880    6015 generic.go:356] "Generic (PLEG): container finished" podID="063cbdd6-3453-4a82-9532-6a846ad94f0e" containerID="0bfbc2da463697a1c83e34332965981bb066bae4adbfba41f8987f421200716c" exitCode=0
Oct 30 19:25:37.623251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.623217    6015 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="c603097725c522c23d562f2d98fafde29b851b4159923b192b384cf5d565c6d7" exitCode=0
Oct 30 19:25:37.623251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.623247    6015 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="d950fd12ea8a86c4ef3629ae66a9cd33890404dda67e9a15a7c895574f061290" exitCode=0
Oct 30 19:25:37.623251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.623257    6015 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="78c3724fd3b81772f9676e45b27b1bb186e15b36c14973271ecbea3d1a79c2cc" exitCode=0
Oct 30 19:25:37.623477 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.623265    6015 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="d6d06e20af3093f79cb9ab8352133624ce1f28cfcf5579baf4a9e74d4fba2c92" exitCode=0
Oct 30 19:25:37.623477 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.623271    6015 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="9fd57b6a98dd697dc2478ea8b258b472790adec8b808fa850076cacf976d57eb" exitCode=0
Oct 30 19:25:37.623477 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.623276    6015 generic.go:356] "Generic (PLEG): container finished" podID="375e75d1-5a8d-4595-8e6b-509edbe45c2d" containerID="a97146feeec3e1ab462cff6e0f58a2b7bb055ebb96446799a7e028cc2af8aca0" exitCode=0
Oct 30 19:25:37.638016 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.637974    6015 generic.go:356] "Generic (PLEG): container finished" podID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerID="ee5cd0214c4bf3bd48520aca619f9ffbe32b5c532c1d3e6cf0eeac0aff27e98e" exitCode=0
Oct 30 19:25:37.645159 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:37.645132    6015 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-34.us-west-2.compute.internal\" not found"
Oct 30 19:25:37.652895 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.652866    6015 generic.go:356] "Generic (PLEG): container finished" podID="b2c68cd55c462db386dbcd1795bbdd95" containerID="2ca2584cd930c312d29eb6aadfe13d115295f3069ed4975666f12e6ae4bc85b8" exitCode=0
Oct 30 19:25:37.676855 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:37.676771    6015 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 19:25:37.681316 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.681293    6015 manager.go:324] Recovery completed
Oct 30 19:25:37.706188 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.706152    6015 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:25:37.708841 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.708799    6015 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 19:25:37.708984 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.708858    6015 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 19:25:37.708984 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.708873    6015 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 19:25:37.712195 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712178    6015 cpu_manager.go:226] "Starting" policy="none"
Oct 30 19:25:37.712195 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712193    6015 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 19:25:37.712385 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712202    6015 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:25:37.712385 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712216    6015 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 19:25:37.712385 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712373    6015 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 19:25:37.712484 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712389    6015 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 19:25:37.712484 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712414    6015 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 19:25:37.712484 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712423    6015 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 19:25:37.712484 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712429    6015 policy_none.go:50] "Start"
Oct 30 19:25:37.712484 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712439    6015 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 19:25:37.712484 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712449    6015 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 19:25:37.712638 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712587    6015 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 19:25:37.712638 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712594    6015 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 19:25:37.712638 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.712600    6015 policy_none.go:44] "Start"
Oct 30 19:25:37.713772 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.713751    6015 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 19:25:37.713870 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.713783    6015 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 19:25:37.713870 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.713793    6015 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 19:25:37.717762 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.717733    6015 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 19:25:37.720347 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.720334    6015 manager.go:341] "Starting Device Plugin manager"
Oct 30 19:25:37.720422 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:37.720358    6015 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 19:25:37.720422 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.720367    6015 server.go:87] "Starting device plugin registration server"
Oct 30 19:25:37.720693 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.720680    6015 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 19:25:37.720738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.720697    6015 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 19:25:37.720835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.720786    6015 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 19:25:37.720963 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.720923    6015 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 19:25:37.721037 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.720974    6015 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 19:25:37.721037 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.720981    6015 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 19:25:37.721127 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.721057    6015 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T19:25:37.720957727Z","UUID":"352ec5bf-5380-44c4-a855-e8f220368016","Handler":null,"Name":"","Endpoint":""}
Oct 30 19:25:37.722589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.722573    6015 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 19:25:37.722589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.722593    6015 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 19:25:37.722909 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:37.722884    6015 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 19:25:37.722995 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:37.722933    6015 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-34.us-west-2.compute.internal\" not found"
Oct 30 19:25:37.729421 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.729394    6015 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 19:25:37.730695 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.730671    6015 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:25:37.730695 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.730675    6015 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:25:37.730866 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.730677    6015 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:25:37.821882 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.821849    6015 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 19:25:37.822831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.822786    6015 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 19:25:37.823072 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.823051    6015 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 19:25:37.823133 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.823082    6015 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 19:25:37.823133 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.823101    6015 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 19:25:37.823223 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.823157    6015 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:37.877236 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.877172    6015 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"]
Oct 30 19:25:37.878019 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.878004    6015 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:37.878099 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.877990    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal" event={"ID":"ceea1ff964927afa3d04bca3afe81300","Type":"ContainerStarted","Data":"6d2cb23c03eba367dc1101941de1c4c6198c065eba9ed70e968a5a15d4785f6b"}
Oct 30 19:25:37.878160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.878129    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal" event={"ID":"ceea1ff964927afa3d04bca3afe81300","Type":"ContainerStarted","Data":"f7798ffabad8992f732acbb9e2ba43f0912c2138a726a6f7121e020da98ef2e3"}
Oct 30 19:25:37.878302 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.878286    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal" event={"ID":"b2c68cd55c462db386dbcd1795bbdd95","Type":"ContainerStarted","Data":"ea0aba97a995a6e2f52ce5b01d22ec8692d96322c660c142a7926b965bf00bb5"}
Oct 30 19:25:37.878387 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.878298    6015 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:37.878387 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.878307    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal" event={"ID":"b2c68cd55c462db386dbcd1795bbdd95","Type":"ContainerDied","Data":"2ca2584cd930c312d29eb6aadfe13d115295f3069ed4975666f12e6ae4bc85b8"}
Oct 30 19:25:37.878387 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.878321    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal" event={"ID":"b2c68cd55c462db386dbcd1795bbdd95","Type":"ContainerStarted","Data":"f0b82694ec3aac43bcc24ebe1a24a36e89559b298ffaf2e97d54915e766ae881"}
Oct 30 19:25:37.926242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.926202    6015 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:37.926394 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.926283    6015 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:37.937822 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.937730    6015 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:25:37.937822 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:37.937780    6015 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:37.938751 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:37.938737    6015 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:25:37.938837 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:37.938764    6015 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.031781 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.031743    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.031781 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.031783    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.031992 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.031859    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ceea1ff964927afa3d04bca3afe81300-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"ceea1ff964927afa3d04bca3afe81300\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.132182 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.132142    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ceea1ff964927afa3d04bca3afe81300-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"ceea1ff964927afa3d04bca3afe81300\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.132182 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.132184    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.132389 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.132207    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.132389 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.132265    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.132389 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.132278    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2c68cd55c462db386dbcd1795bbdd95-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"b2c68cd55c462db386dbcd1795bbdd95\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.132389 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.132278    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ceea1ff964927afa3d04bca3afe81300-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal\" (UID: \"ceea1ff964927afa3d04bca3afe81300\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.527238 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.527203    6015 apiserver.go:52] "Watching apiserver"
Oct 30 19:25:38.630888 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.630849    6015 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 19:25:38.631593 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.631567    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal","openshift-dns/node-resolver-7gqc6","openshift-monitoring/metrics-server-56bf65fd49-dp7vl","openshift-monitoring/thanos-querier-5dffbb6d99-swjqg","kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal","openshift-ingress-canary/ingress-canary-72djl","openshift-insights/insights-runtime-extractor-x4n4k","openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6","openshift-multus/multus-additional-cni-plugins-7nss2","openshift-multus/multus-qzjg5","openshift-image-registry/node-ca-p8prw","openshift-network-operator/iptables-alerter-5nxn8","openshift-network-diagnostics/network-check-target-q9pln","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr","openshift-monitoring/node-exporter-n47m6","openshift-monitoring/prometheus-k8s-0","openshift-ovn-kubernetes/ovnkube-node-rbq4b","kube-system/konnectivity-agent-4nbnr","openshift-cluster-node-tuning-operator/tuned-w4zck","openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg","openshift-monitoring/telemeter-client-66fcfc996c-q2j5x","kube-system/global-pull-secret-syncer-xmsrx","openshift-dns/dns-default-whdq6","openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv","openshift-multus/network-metrics-daemon-hs2pz","openshift-console/console-c49cd799b-652dx"]
Oct 30 19:25:38.656894 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.656866    6015 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.657057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.656956    6015 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.683732 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.683704    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lzgjh\""
Oct 30 19:25:38.683732 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.683704    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jxzqp\""
Oct 30 19:25:38.684154 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.684137    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 19:25:38.684685 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.684672    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 19:25:38.686494 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.686469    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-s4fj9\""
Oct 30 19:25:38.686494 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.686479    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 19:25:38.686762 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.686744    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.687017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.687004    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.687081 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.687065    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.687081 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.687067    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.687168 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.687083    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.687168 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.687121    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.687262 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.687224    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.687262 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.687242    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4g88n\""
Oct 30 19:25:38.687446 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.687432    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 19:25:38.687482 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.687471    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9jbqb\""
Oct 30 19:25:38.688519 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.688505    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.690509 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.690495    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-vwkbz\""
Oct 30 19:25:38.690781 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.690768    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 19:25:38.691016 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.691004    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6prqp\""
Oct 30 19:25:38.691311 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.691297    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 19:25:38.691359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.691313    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2d46\""
Oct 30 19:25:38.691359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.691321    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hthrr\""
Oct 30 19:25:38.691553 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.691537    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 19:25:38.691605 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.691590    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-ndzf5\""
Oct 30 19:25:38.691838 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.691824    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.692040 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.692025    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6ftg5\""
Oct 30 19:25:38.692119 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.692106    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.692328 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.692317    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 19:25:38.692362 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.692322    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.692553 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.692542    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 19:25:38.692599 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.692550    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 19:25:38.692599 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.692578    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.692599 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.692578    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.692696 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.692632    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.696416 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.696404    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 19:25:38.720857 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.720831    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 19:25:38.735062 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735035    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-bin\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.735155 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735068    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.735155 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735088    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-var-lib-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.735155 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735117    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-metrics-client-ca\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.735300 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735174    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qph6d\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-kube-api-access-qph6d\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.735300 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735248    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lxqm\" (UniqueName: \"kubernetes.io/projected/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-kube-api-access-8lxqm\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:38.735374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735300    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-lib-modules\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.735443 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735427    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovn-node-metrics-cert\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.735495 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735453    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-tmp-dir\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:25:38.735495 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735472    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mr4s\" (UniqueName: \"kubernetes.io/projected/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-kube-api-access-8mr4s\") pod \"ingress-canary-72djl\" (UID: \"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526\") " pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:38.735582 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735498    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:38.735582 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735521    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-host\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.735582 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735545    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-netd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.735582 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735569    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-tmp-dir\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:25:38.735770 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735602    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-client-tls\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.735770 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735638    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/69657bb8-0d16-4aeb-9388-5184569b0114-audit-log\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.735770 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735669    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cnibin\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.735770 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735695    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-metrics-server-audit-profiles\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.735770 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735714    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/69657bb8-0d16-4aeb-9388-5184569b0114-audit-log\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.735770 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735727    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:38.735770 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735747    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-metrics-certs\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:38.735770 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735756    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.736033 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735793    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52746fc1-d7cc-449f-9f24-bfd4730769d2-host\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:25:38.736033 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735852    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-conf\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.736033 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735882    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx6n9\" (UniqueName: \"kubernetes.io/projected/a4f2cbed-435d-41ed-a904-aab4c3dd4559-kube-api-access-zx6n9\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.736033 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735898    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/967c1b48-0633-4580-8075-ea41321e866b-tmp\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.736033 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735945    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-textfile\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.736033 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.735962    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/967c1b48-0633-4580-8075-ea41321e866b-tmp\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.736033 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736002    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-textfile\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.736033 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736000    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm7qf\" (UniqueName: \"kubernetes.io/projected/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-kube-api-access-jm7qf\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:38.736033 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736032    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-conf-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.736261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736101    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-data-volume\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:38.736261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736129    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:38.736261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736152    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-data-volume\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:38.736261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736155    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.736261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736195    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.736261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736216    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.736261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736233    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d78689c3-56b1-481c-9ef7-bf81b9a9679e-tmp\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.736261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736255    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.736473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736279    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-k8s-cni-cncf-io\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.736473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736297    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.736473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736299    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d78689c3-56b1-481c-9ef7-bf81b9a9679e-tmp\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.736473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736314    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.736473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736348    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.736473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736383    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:38.736473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736405    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-serving-cert\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.736473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736421    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.736707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736515    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ca4d390-4036-4689-8ecd-d13b149ff6ba-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k7fj6\" (UID: \"0ca4d390-4036-4689-8ecd-d13b149ff6ba\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:38.736707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736535    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-ovn\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.736707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736560    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcrpv\" (UniqueName: \"kubernetes.io/projected/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-kube-api-access-hcrpv\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.736707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736597    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52746fc1-d7cc-449f-9f24-bfd4730769d2-serviceca\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:25:38.736707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736633    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c8a6569-544e-4574-a9f2-0b5396a40984-config-volume\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:38.736707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736658    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-sys\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.736707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736673    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.736707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736689    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-etc-kubernetes\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.736941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736715    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d78689c3-56b1-481c-9ef7-bf81b9a9679e-metrics-client-ca\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.736941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736745    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5plx\" (UniqueName: \"kubernetes.io/projected/2cac4841-e958-412a-b876-212f39aa120f-kube-api-access-r5plx\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.736941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736848    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-systemd-units\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.737022 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.736967    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-node-log\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.737022 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737018    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-federate-client-tls\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.737087 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737036    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhffg\" (UniqueName: \"kubernetes.io/projected/69657bb8-0d16-4aeb-9388-5184569b0114-kube-api-access-jhffg\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.737087 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737053    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-kubelet\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.737087 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737074    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjkkg\" (UniqueName: \"kubernetes.io/projected/0ca4d390-4036-4689-8ecd-d13b149ff6ba-kube-api-access-tjkkg\") pod \"monitoring-plugin-77f4f76594-k7fj6\" (UID: \"0ca4d390-4036-4689-8ecd-d13b149ff6ba\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:38.737190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737092    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.737190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737115    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-oauth-config\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.737190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737163    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/586f9624-2168-4588-a01f-9cc483699682-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.737190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737179    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52746fc1-d7cc-449f-9f24-bfd4730769d2-serviceca\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:25:38.737367 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737246    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d5f797e-c46a-47fd-9a80-570a83b355ff-konnectivity-ca\") pod \"konnectivity-agent-4nbnr\" (UID: \"3d5f797e-c46a-47fd-9a80-570a83b355ff\") " pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:25:38.737367 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737254    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/586f9624-2168-4588-a01f-9cc483699682-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.737367 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737282    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-grpc-tls\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.737367 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737309    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-run\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.737367 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737357    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.737563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737392    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.737563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737412    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c8a6569-544e-4574-a9f2-0b5396a40984-tmp-dir\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:38.737563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737431    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d5f797e-c46a-47fd-9a80-570a83b355ff-konnectivity-ca\") pod \"konnectivity-agent-4nbnr\" (UID: \"3d5f797e-c46a-47fd-9a80-570a83b355ff\") " pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:25:38.737563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737462    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-wtmp\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.737563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737473    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c8a6569-544e-4574-a9f2-0b5396a40984-tmp-dir\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:38.737563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737499    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.737563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737529    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737557    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737603    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-daemon-config\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737647    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-systemd\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737667    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-tmp\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737685    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-kubelet\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737707    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-etc-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737724    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-tls\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737741    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfz4r\" (UniqueName: \"kubernetes.io/projected/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-kube-api-access-xfz4r\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737750    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-tmp\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737757    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-daemon-config\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737757    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-etc-tuned\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.737828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737826    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2cac4841-e958-412a-b876-212f39aa120f-etc-tuned\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737825    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86595af1-257c-481b-8896-7b79fef64d5c-iptables-alerter-script\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737858    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-config\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737875    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cni-binary-copy\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737897    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-service-ca\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737913    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737928    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-kubernetes\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737948    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dstt\" (UniqueName: \"kubernetes.io/projected/8c8a6569-544e-4574-a9f2-0b5396a40984-kube-api-access-4dstt\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737973    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-console-config\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.737998    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738012    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86595af1-257c-481b-8896-7b79fef64d5c-iptables-alerter-script\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738046    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738031    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-config\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738075    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738103    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738134    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkjjx\" (UniqueName: \"kubernetes.io/projected/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-api-access-rkjjx\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738160    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cni-binary-copy\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738198    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-oauth-serving-cert\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738239    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738253    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738283    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7vgf\" (UniqueName: \"kubernetes.io/projected/586f9624-2168-4588-a01f-9cc483699682-kube-api-access-n7vgf\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738311    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-client-certs\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738342    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-socket-dir-parent\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738376    6015 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738374    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.738447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738445    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738473    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-hosts-file\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:38.738518    6015 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738518    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-registration-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738568    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-metrics-client-ca\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738595    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp52t\" (UniqueName: \"kubernetes.io/projected/52746fc1-d7cc-449f-9f24-bfd4730769d2-kube-api-access-qp52t\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738620    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-netns\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738645    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738672    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-trusted-ca-bundle\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738719    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgdcb\" (UniqueName: \"kubernetes.io/projected/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-kube-api-access-fgdcb\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738753    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-systemd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738793    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-env-overrides\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738860    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738914    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cnibin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738948    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.738980    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-tls\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739050    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj472\" (UniqueName: \"kubernetes.io/projected/375e75d1-5a8d-4595-8e6b-509edbe45c2d-kube-api-access-kj472\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739069    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-socket-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739086    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c8a6569-544e-4574-a9f2-0b5396a40984-metrics-tls\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739102    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739117    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-cert\") pod \"ingress-canary-72djl\" (UID: \"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526\") " pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739140    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-modprobe-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739169    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739228    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739228    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brbm2\" (UniqueName: \"kubernetes.io/projected/d78689c3-56b1-481c-9ef7-bf81b9a9679e-kube-api-access-brbm2\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739302    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86595af1-257c-481b-8896-7b79fef64d5c-host-slash\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739330    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gh5n\" (UniqueName: \"kubernetes.io/projected/86595af1-257c-481b-8896-7b79fef64d5c-kube-api-access-8gh5n\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739349    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbxc8\" (UniqueName: \"kubernetes.io/projected/967c1b48-0633-4580-8075-ea41321e866b-kube-api-access-nbxc8\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.739375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739374    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739400    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739452    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-sys\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739478    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739517    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-script-lib\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739566    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-kubelet-config\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739594    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-crio-socket\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739625    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-dbus\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739657    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-system-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739677    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-hostroot\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739705    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739797    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-netns\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739845    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-root\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739873    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739873    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739909    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-sys-fs\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739957    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.739991    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740011    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysconfig\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740027    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-var-lib-kubelet\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740043    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-device-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740072    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740104    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7vnf\" (UniqueName: \"kubernetes.io/projected/063cbdd6-3453-4a82-9532-6a846ad94f0e-kube-api-access-m7vnf\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740207    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-system-cni-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.740251 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740266    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-etc-selinux\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740301    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-log-socket\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740333    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-tls\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740381    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-web-config\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740457    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d5f797e-c46a-47fd-9a80-570a83b355ff-agent-certs\") pod \"konnectivity-agent-4nbnr\" (UID: \"3d5f797e-c46a-47fd-9a80-570a83b355ff\") " pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740441    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-original-pull-secret\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740587    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-bin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740616    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pttk\" (UniqueName: \"kubernetes.io/projected/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kube-api-access-2pttk\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740633    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740652    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-serving-certs-ca-bundle\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740674    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-client-ca-bundle\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740686    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d5f797e-c46a-47fd-9a80-570a83b355ff-agent-certs\") pod \"konnectivity-agent-4nbnr\" (UID: \"3d5f797e-c46a-47fd-9a80-570a83b355ff\") " pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740716    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-out\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740821    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-multus\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740857    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-multus-certs\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740875    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-slash\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.741193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.740983    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-out\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.746453 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.746434    6015 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 19:25:38.751505 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.751491    6015 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 19:25:38.751556 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:38.751542    6015 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.us-west-2.compute.internal"
Oct 30 19:25:38.783417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.783317    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 19:25:38.783417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.783335    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 19:25:38.783417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.783350    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 19:25:38.783417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.783351    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 19:25:38.783417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.783403    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.783645 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.783477    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 19:25:38.784952 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.784929    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 19:25:38.785488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.785440    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 19:25:38.785488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.785475    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 19:25:38.785689 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.785498    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.785689 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.785619    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 19:25:38.785689 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.785629    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.785885 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.785866    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.785952 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.785906    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.786117 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.786100    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.786117 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.786101    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-metrics-server-audit-profiles\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.786255 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.786241    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.786459 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.786446    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.786505 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.786474    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 19:25:38.786562 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.786530    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 19:25:38.786603 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.786576    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69657bb8-0d16-4aeb-9388-5184569b0114-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.788578 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.788559    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-oauth-serving-cert\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.788932 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.788914    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:38.789139 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789118    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 19:25:38.789139 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789135    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 19:25:38.789269 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789145    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 19:25:38.789269 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789166    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 19:25:38.789269 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789178    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 19:25:38.789269 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789184    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 19:25:38.789269 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789202    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 19:25:38.789269 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789220    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 19:25:38.789445 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789309    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 19:25:38.789445 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789328    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 19:25:38.789445 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789419    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.789524 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789503    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 19:25:38.789579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789556    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 19:25:38.789713 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789696    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 19:25:38.789798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789747    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 19:25:38.789798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789763    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 19:25:38.789798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789773    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 19:25:38.789798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789767    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 19:25:38.789798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789798    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 19:25:38.790057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789852    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 19:25:38.790057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789859    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 19:25:38.790057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789861    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 19:25:38.790057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789861    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 19:25:38.790057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789866    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 19:25:38.790057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.789966    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 19:25:38.790057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790041    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6nsf6\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790077    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790105    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790149    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9rgsb2985p4kr\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790159    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790160    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790194    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790221    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-48djs\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790229    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790406    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790453    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790475    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8b6ps\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790486    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-stvjk\""
Oct 30 19:25:38.790475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790506    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7ugdki2ohn280\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790542    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tg4xp\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790551    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fvq7j\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790572    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790591    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790601    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f29wx\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790630    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790642    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790654    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-web-config\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790667    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790669    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790485    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790687    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790682    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790705    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790713    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790721    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790711    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-tls\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790743    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790750    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8x78l\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790554    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 19:25:38.791149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.791125    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8mnv5\""
Oct 30 19:25:38.792017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.791168    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w9lxj\""
Oct 30 19:25:38.792017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.790784    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 19:25:38.792017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.791227    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-serving-certs-ca-bundle\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.792017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.791366    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-9th84\""
Oct 30 19:25:38.795712 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.795686    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovn-node-metrics-cert\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.795833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.795691    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-metrics-client-ca\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.795880 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.795863    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-client-tls\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.796005 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.795993    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:38.796390 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.796376    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.796485 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.796466    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:38.796526 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.796489    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.796564 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.796528    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.796596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.796567    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.796636 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.796626    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-serving-cert\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.796667 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.796628    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.797906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.797786    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.797906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.797817    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-federate-client-tls\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.797906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.797794    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.797906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.797852    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.797906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.797860    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d78689c3-56b1-481c-9ef7-bf81b9a9679e-metrics-client-ca\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.797906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.797879    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c8a6569-544e-4574-a9f2-0b5396a40984-config-volume\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:38.797906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.797880    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-oauth-config\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.797906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.797895    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-grpc-tls\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.798283 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.797920    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.798283 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.797977    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-tls\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.798283 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.798101    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-service-ca\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.798283 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.798204    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.798283 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.798280    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.798437 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.798285    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.798561 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.798545    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-console-config\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.798702 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.798684    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.798768 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.798684    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.798823 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.798766    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.798823 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.798768    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-secret-metrics-server-client-certs\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.798895 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.798820    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-metrics-client-ca\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.799440 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.799420    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-cert\") pod \"ingress-canary-72djl\" (UID: \"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526\") " pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:38.799517 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.799469    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-env-overrides\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.799517 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.799473    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:38.799517 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.799474    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-secret-telemeter-client\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.799517 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.799510    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c8a6569-544e-4574-a9f2-0b5396a40984-metrics-tls\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:38.799636 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.799550    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.799721 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.799708    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4f2cbed-435d-41ed-a904-aab4c3dd4559-ovnkube-script-lib\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.830151 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.830115    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 19:25:38.830314 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.830115    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-h7j6c\""
Oct 30 19:25:38.830314 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.830115    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sd2hg\""
Oct 30 19:25:38.830314 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.830123    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6rdh1lpcl4r57\""
Oct 30 19:25:38.830314 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.830150    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qkj5g\""
Oct 30 19:25:38.830314 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.830150    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 19:25:38.831492 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.831475    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69657bb8-0d16-4aeb-9388-5184569b0114-client-ca-bundle\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.832195 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.832179    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 19:25:38.836572 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.836539    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/586f9624-2168-4588-a01f-9cc483699682-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.836836    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ca4d390-4036-4689-8ecd-d13b149ff6ba-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k7fj6\" (UID: \"0ca4d390-4036-4689-8ecd-d13b149ff6ba\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.837233    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lxqm\" (UniqueName: \"kubernetes.io/projected/fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24-kube-api-access-8lxqm\") pod \"network-metrics-daemon-hs2pz\" (UID: \"fe4c7c1f-b9ad-492d-bbf8-b9bf4ac98d24\") " pod="openshift-multus/network-metrics-daemon-hs2pz"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.837335    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgdcb\" (UniqueName: \"kubernetes.io/projected/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-kube-api-access-fgdcb\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.837472    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7vgf\" (UniqueName: \"kubernetes.io/projected/586f9624-2168-4588-a01f-9cc483699682-kube-api-access-n7vgf\") pod \"kube-state-metrics-5dc8d7d89b-8mlrg\" (UID: \"586f9624-2168-4588-a01f-9cc483699682\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-8mlrg"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.837495    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qph6d\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-kube-api-access-qph6d\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.837613    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkjjx\" (UniqueName: \"kubernetes.io/projected/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-kube-api-access-rkjjx\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.837730    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.837742    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7vnf\" (UniqueName: \"kubernetes.io/projected/063cbdd6-3453-4a82-9532-6a846ad94f0e-kube-api-access-m7vnf\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.837787    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gh5n\" (UniqueName: \"kubernetes.io/projected/86595af1-257c-481b-8896-7b79fef64d5c-kube-api-access-8gh5n\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.837916    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.837927    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcrpv\" (UniqueName: \"kubernetes.io/projected/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-kube-api-access-hcrpv\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838162    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj472\" (UniqueName: \"kubernetes.io/projected/375e75d1-5a8d-4595-8e6b-509edbe45c2d-kube-api-access-kj472\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838194    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm7qf\" (UniqueName: \"kubernetes.io/projected/c4e772a6-140b-4d72-873d-ac43b9b2f0a3-kube-api-access-jm7qf\") pod \"openshift-state-metrics-7bd7489957-tc9dv\" (UID: \"c4e772a6-140b-4d72-873d-ac43b9b2f0a3\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tc9dv"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838223    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pttk\" (UniqueName: \"kubernetes.io/projected/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kube-api-access-2pttk\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838299    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dstt\" (UniqueName: \"kubernetes.io/projected/8c8a6569-544e-4574-a9f2-0b5396a40984-kube-api-access-4dstt\") pod \"dns-default-whdq6\" (UID: \"8c8a6569-544e-4574-a9f2-0b5396a40984\") " pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838397    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5plx\" (UniqueName: \"kubernetes.io/projected/2cac4841-e958-412a-b876-212f39aa120f-kube-api-access-r5plx\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838435    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838521    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhffg\" (UniqueName: \"kubernetes.io/projected/69657bb8-0d16-4aeb-9388-5184569b0114-kube-api-access-jhffg\") pod \"metrics-server-56bf65fd49-dp7vl\" (UID: \"69657bb8-0d16-4aeb-9388-5184569b0114\") " pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838579    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838632    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjkkg\" (UniqueName: \"kubernetes.io/projected/0ca4d390-4036-4689-8ecd-d13b149ff6ba-kube-api-access-tjkkg\") pod \"monitoring-plugin-77f4f76594-k7fj6\" (UID: \"0ca4d390-4036-4689-8ecd-d13b149ff6ba\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838717    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838722    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfz4r\" (UniqueName: \"kubernetes.io/projected/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-kube-api-access-xfz4r\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838936    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbxc8\" (UniqueName: \"kubernetes.io/projected/967c1b48-0633-4580-8075-ea41321e866b-kube-api-access-nbxc8\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838950    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brbm2\" (UniqueName: \"kubernetes.io/projected/d78689c3-56b1-481c-9ef7-bf81b9a9679e-kube-api-access-brbm2\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.838952    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp52t\" (UniqueName: \"kubernetes.io/projected/52746fc1-d7cc-449f-9f24-bfd4730769d2-kube-api-access-qp52t\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:25:38.838995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.839020    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-trusted-ca-bundle\") pod \"console-c49cd799b-652dx\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") " pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:38.840611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.839170    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwv6\" (UniqueName: \"kubernetes.io/projected/81010882-395a-4762-b410-527c640e91ed-kube-api-access-6bwv6\") pod \"network-check-target-q9pln\" (UID: \"81010882-395a-4762-b410-527c640e91ed\") " pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:38.840611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.839179    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d78689c3-56b1-481c-9ef7-bf81b9a9679e-secret-thanos-querier-tls\") pod \"thanos-querier-5dffbb6d99-swjqg\" (UID: \"d78689c3-56b1-481c-9ef7-bf81b9a9679e\") " pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:38.840611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.839255    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx6n9\" (UniqueName: \"kubernetes.io/projected/a4f2cbed-435d-41ed-a904-aab4c3dd4559-kube-api-access-zx6n9\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.840611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.839265    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mr4s\" (UniqueName: \"kubernetes.io/projected/dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526-kube-api-access-8mr4s\") pod \"ingress-canary-72djl\" (UID: \"dbe02f9a-0f0e-4b41-967f-3c3a3a3e8526\") " pod="openshift-ingress-canary/ingress-canary-72djl"
Oct 30 19:25:38.840611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.840602    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc905dc2-23e8-4237-8874-f2e9d8ae50a4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66fcfc996c-q2j5x\" (UID: \"cc905dc2-23e8-4237-8874-f2e9d8ae50a4\") " pod="openshift-monitoring/telemeter-client-66fcfc996c-q2j5x"
Oct 30 19:25:38.841470 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841452    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.841509 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841478    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.841509 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841493    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.841608 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841508    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-var-lib-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.841608 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841526    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.841608 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841549    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-lib-modules\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.841608 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841579    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.841608 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841584    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-var-lib-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.841608 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841584    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.841608 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841603    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-host\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841624    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-netd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841649    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cnibin\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841669    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841675    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-host\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841688    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52746fc1-d7cc-449f-9f24-bfd4730769d2-host\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841689    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841701    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841711    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-lib-modules\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841726    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-cnibin\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841731    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841751    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-netd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841751    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52746fc1-d7cc-449f-9f24-bfd4730769d2-host\") pod \"node-ca-p8prw\" (UID: \"52746fc1-d7cc-449f-9f24-bfd4730769d2\") " pod="openshift-image-registry/node-ca-p8prw"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841756    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841790    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841823    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-conf\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841835    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841847    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-conf-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841842    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841883    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-k8s-cni-cncf-io\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841898    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-conf-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841905    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-ovn\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.841914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841921    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-k8s-cni-cncf-io\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841932    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-sys\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841945    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841962    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841968    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-conf\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841925    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-ovn\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.841982    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-sys\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842015    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-etc-kubernetes\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842018    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842036    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-systemd-units\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842048    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-etc-kubernetes\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842060    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-node-log\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842075    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-systemd-units\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842088    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842101    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-node-log\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842116    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-kubelet\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842140    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842153    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-run\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842175    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842195    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-kubelet\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842201    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-wtmp\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842215    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-run\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842229    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842236    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-systemd\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842260    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-kubelet\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842282    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-etc-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842281    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-systemd\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842303    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-etc-openvswitch\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842307    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842263    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-node-exporter-wtmp\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842346    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-kubernetes\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842283    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-kubelet\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842375    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842390    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-kubernetes\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842401    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-web-config\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842428    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842402    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842459    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-socket-dir-parent\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842484    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-hosts-file\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842501    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842510    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-registration-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842512    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842558    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-multus-socket-dir-parent\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842545    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-netns\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842562    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4-hosts-file\") pod \"node-resolver-7gqc6\" (UID: \"bd8ca9b6-c7a6-41e2-b335-98f6ba49c4e4\") " pod="openshift-dns/node-resolver-7gqc6"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842582    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-registration-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842590    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-netns\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842585    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-web-config\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842606    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842598    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842644    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-systemd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842663    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cnibin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842680    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-config\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842685    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-run-systemd\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842705    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842727    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842733    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-cnibin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842743    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-socket-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842737    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.842742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842761    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-config-out\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842835    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-socket-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842867    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842892    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-modprobe-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842897    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-config-out\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842910    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86595af1-257c-481b-8896-7b79fef64d5c-host-slash\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842932    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86595af1-257c-481b-8896-7b79fef64d5c-host-slash\") pod \"iptables-alerter-5nxn8\" (UID: \"86595af1-257c-481b-8896-7b79fef64d5c\") " pod="openshift-network-operator/iptables-alerter-5nxn8"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842936    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842952    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-sys\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842968    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.842986    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-kubelet-config\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843004    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-modprobe-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843011    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-crio-socket\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843029    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-sys\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843047    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843059    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98b5e381-31e7-4ca3-a2f3-c0f59d34bd41-crio-socket\") pod \"insights-runtime-extractor-x4n4k\" (UID: \"98b5e381-31e7-4ca3-a2f3-c0f59d34bd41\") " pod="openshift-insights/insights-runtime-extractor-x4n4k"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843066    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-kubelet-config\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843057    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843086    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysctl-d\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843097    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-dbus\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843112    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/36c3af0c-ac42-4a11-9fbd-ebc48700b9d2-dbus\") pod \"global-pull-secret-syncer-xmsrx\" (UID: \"36c3af0c-ac42-4a11-9fbd-ebc48700b9d2\") " pod="kube-system/global-pull-secret-syncer-xmsrx"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843136    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-system-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843160    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-hostroot\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843162    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-config\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843193    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-system-cni-dir\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843205    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-hostroot\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843228    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843246    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-netns\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843261    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-root\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843289    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/063cbdd6-3453-4a82-9532-6a846ad94f0e-root\") pod \"node-exporter-n47m6\" (UID: \"063cbdd6-3453-4a82-9532-6a846ad94f0e\") " pod="openshift-monitoring/node-exporter-n47m6"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843293    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-run-netns\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843303    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843323    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-sys-fs\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843344    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysconfig\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843357    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-var-lib-kubelet\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843375    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-device-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843383    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-sys-fs\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843422    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-system-cni-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843436    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-var-lib-kubelet\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843446    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-etc-selinux\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843424    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2cac4841-e958-412a-b876-212f39aa120f-etc-sysconfig\") pod \"tuned-w4zck\" (UID: \"2cac4841-e958-412a-b876-212f39aa120f\") " pod="openshift-cluster-node-tuning-operator/tuned-w4zck"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843469    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-device-dir\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843470    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-log-socket\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843487    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/375e75d1-5a8d-4595-8e6b-509edbe45c2d-system-cni-dir\") pod \"multus-additional-cni-plugins-7nss2\" (UID: \"375e75d1-5a8d-4595-8e6b-509edbe45c2d\") " pod="openshift-multus/multus-additional-cni-plugins-7nss2"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843493    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78ba6c78-49c1-47e1-a0bd-4ae3f6784d46-etc-selinux\") pod \"aws-ebs-csi-driver-node-55qcr\" (UID: \"78ba6c78-49c1-47e1-a0bd-4ae3f6784d46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55qcr"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843503    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-log-socket\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843509    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843542    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-bin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843574    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843593    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-bin\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843603    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk7v4\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-kube-api-access-wk7v4\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843622    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843629    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-multus\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843654    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-multus-certs\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843678    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-slash\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843699    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-var-lib-cni-multus\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843705    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-bin\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843717    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7fa839e-ab2c-493b-b53a-79e769aa7d4a-host-run-multus-certs\") pod \"multus-qzjg5\" (UID: \"a7fa839e-ab2c-493b-b53a-79e769aa7d4a\") " pod="openshift-multus/multus-qzjg5"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843730    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843737    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-slash\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843746    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4f2cbed-435d-41ed-a904-aab4c3dd4559-host-cni-bin\") pod \"ovnkube-node-rbq4b\" (UID: \"a4f2cbed-435d-41ed-a904-aab4c3dd4559\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.843934    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.844618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.844470    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:38.846527 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.846498    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:38.901611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:38.901572    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk7v4\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-kube-api-access-wk7v4\") pod \"prometheus-k8s-0\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:39.239233 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:39.239193    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:39.258954 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:39.258929    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:39.339374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:39.339333    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:39.344137 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:39.344111    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7fj6"
Oct 30 19:25:41.520165 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:41.520124    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-whdq6"
Oct 30 19:25:41.754637 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:41.754608    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:41.856823 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:41.856778    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:25:41.898381 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:41.898345    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:42.054696 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:42.054659    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:42.997028 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:42.996994    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c49cd799b-652dx"]
Oct 30 19:25:43.008119 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:43.008086    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:25:43.257083 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:43.256988    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:43.261096 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:43.261072    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5dffbb6d99-swjqg"
Oct 30 19:25:43.688263 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:43.688235    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:43.898027 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:43.897994    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:44.118347 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:44.118310    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:44.297050 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:44.297017    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:45.710003 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:45.709975    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:25:45.710444 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:45.710229    6015 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 19:25:48.327008 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:48.326964    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:48.811331 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:48.811297    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:49.640189 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.640142    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:25:49.640579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.640437    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="alertmanager" containerID="cri-o://fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c" gracePeriod=120
Oct 30 19:25:49.640579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.640502    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy-metric" containerID="cri-o://e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831" gracePeriod=120
Oct 30 19:25:49.640579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.640544    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="prom-label-proxy" containerID="cri-o://d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4" gracePeriod=120
Oct 30 19:25:49.640579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.640557    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="config-reloader" containerID="cri-o://ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31" gracePeriod=120
Oct 30 19:25:49.640780 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.640573    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy" containerID="cri-o://ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902" gracePeriod=120
Oct 30 19:25:49.640780 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.640512    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy-web" containerID="cri-o://ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7" gracePeriod=120
Oct 30 19:25:49.904202 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.904144    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:49.947060 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947027    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-main-db\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947187 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947091    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-trusted-ca-bundle\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947187 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947142    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-metrics-client-ca\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947187 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947166    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-volume\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-volume\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947206    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947242    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947284    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-web-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-web-config\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947319    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-out\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947355    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947398    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-main-tls\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947429    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-kube-api-access-qph6d\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-kube-api-access-qph6d\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947449    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-cluster-tls-config\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947464    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-tls-assets\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-tls-assets\") pod \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\" (UID: \"5ab4c499-e0ea-4f67-b673-c2f8957d06ac\") "
Oct 30 19:25:49.947538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947465    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-main-db" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:25:49.947788 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947539    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-trusted-ca-bundle" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:25:49.947870 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947845    6015 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-main-db\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:49.947921 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.947869    6015 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:49.948130 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.948101    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-metrics-client-ca" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:25:49.951269 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.951215    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-metric" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:49.951394 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.951303    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-kube-api-access-qph6d" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "kube-api-access-qph6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:25:49.951596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.951555    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-main-tls" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:49.951968 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.951921    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:49.952229 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.952201    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-out" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:25:49.952300 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.952247    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-volume" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:49.952491 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.952471    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-tls-assets" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:25:49.952560 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.952503    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-web" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:49.956110 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.956088    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-cluster-tls-config" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:49.963557 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:49.963527    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-web-config" pod "5ab4c499-e0ea-4f67-b673-c2f8957d06ac" (UID: "5ab4c499-e0ea-4f67-b673-c2f8957d06ac"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:50.048554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.048347    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-metrics-client-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:50.048554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.048383    6015 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:50.048554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.048398    6015 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:50.048554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.048411    6015 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:50.048554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.048451    6015 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-web-config\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:50.048554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.048465    6015 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-config-out\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:50.048554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.048477    6015 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:50.048554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.048490    6015 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-secret-alertmanager-main-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:50.048554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.048503    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qph6d\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-kube-api-access-qph6d\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:50.048554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.048516    6015 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-cluster-tls-config\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:50.048554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.048528    6015 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ab4c499-e0ea-4f67-b673-c2f8957d06ac-tls-assets\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:50.715935 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.715899    6015 generic.go:356] "Generic (PLEG): container finished" podID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerID="d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4" exitCode=0
Oct 30 19:25:50.715935 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.715928    6015 generic.go:356] "Generic (PLEG): container finished" podID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerID="e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831" exitCode=0
Oct 30 19:25:50.715935 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.715938    6015 generic.go:356] "Generic (PLEG): container finished" podID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerID="ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902" exitCode=0
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.715948    6015 generic.go:356] "Generic (PLEG): container finished" podID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerID="ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7" exitCode=0
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.715956    6015 generic.go:356] "Generic (PLEG): container finished" podID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerID="ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31" exitCode=0
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.715962    6015 generic.go:356] "Generic (PLEG): container finished" podID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerID="fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c" exitCode=0
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.715973    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.716017    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerDied","Data":"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"}
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.716083    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerDied","Data":"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"}
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.716110    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerDied","Data":"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"}
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.716133    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerDied","Data":"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"}
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.716155    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerDied","Data":"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"}
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.716157    6015 scope.go:122] "RemoveContainer" containerID="d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.716178    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerDied","Data":"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"}
Oct 30 19:25:50.716463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.716202    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ab4c499-e0ea-4f67-b673-c2f8957d06ac","Type":"ContainerDied","Data":"539c17aa278d6e8e3ffbc588b0d4339a55f2197d41a9ce23cd192f2529b493c2"}
Oct 30 19:25:50.724482 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.724463    6015 scope.go:122] "RemoveContainer" containerID="e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"
Oct 30 19:25:50.731866 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.731842    6015 scope.go:122] "RemoveContainer" containerID="ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"
Oct 30 19:25:50.739248 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.739231    6015 scope.go:122] "RemoveContainer" containerID="ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"
Oct 30 19:25:50.746417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.746398    6015 scope.go:122] "RemoveContainer" containerID="ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"
Oct 30 19:25:50.759338 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.759038    6015 scope.go:122] "RemoveContainer" containerID="fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"
Oct 30 19:25:50.767863 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.767843    6015 scope.go:122] "RemoveContainer" containerID="30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"
Oct 30 19:25:50.775542 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.775517    6015 scope.go:122] "RemoveContainer" containerID="d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"
Oct 30 19:25:50.775918 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:50.775895    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": container with ID starting with d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4 not found: ID does not exist" containerID="d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"
Oct 30 19:25:50.775997 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.775928    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"} err="failed to get container status \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": rpc error: code = NotFound desc = could not find container \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": container with ID starting with d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4 not found: ID does not exist"
Oct 30 19:25:50.775997 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.775963    6015 scope.go:122] "RemoveContainer" containerID="e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"
Oct 30 19:25:50.776219 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:50.776203    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": container with ID starting with e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831 not found: ID does not exist" containerID="e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"
Oct 30 19:25:50.776252 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.776224    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"} err="failed to get container status \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": rpc error: code = NotFound desc = could not find container \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": container with ID starting with e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831 not found: ID does not exist"
Oct 30 19:25:50.776252 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.776241    6015 scope.go:122] "RemoveContainer" containerID="ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"
Oct 30 19:25:50.776473 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:50.776459    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": container with ID starting with ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902 not found: ID does not exist" containerID="ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"
Oct 30 19:25:50.776525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.776476    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"} err="failed to get container status \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": rpc error: code = NotFound desc = could not find container \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": container with ID starting with ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902 not found: ID does not exist"
Oct 30 19:25:50.776525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.776488    6015 scope.go:122] "RemoveContainer" containerID="ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"
Oct 30 19:25:50.776708 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:50.776693    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": container with ID starting with ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7 not found: ID does not exist" containerID="ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"
Oct 30 19:25:50.776748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.776713    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"} err="failed to get container status \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": rpc error: code = NotFound desc = could not find container \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": container with ID starting with ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7 not found: ID does not exist"
Oct 30 19:25:50.776748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.776726    6015 scope.go:122] "RemoveContainer" containerID="ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"
Oct 30 19:25:50.776968 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:50.776954    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": container with ID starting with ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31 not found: ID does not exist" containerID="ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"
Oct 30 19:25:50.777036 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.776981    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"} err="failed to get container status \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": rpc error: code = NotFound desc = could not find container \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": container with ID starting with ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31 not found: ID does not exist"
Oct 30 19:25:50.777036 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.776993    6015 scope.go:122] "RemoveContainer" containerID="fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"
Oct 30 19:25:50.777215 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:50.777198    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": container with ID starting with fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c not found: ID does not exist" containerID="fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"
Oct 30 19:25:50.777250 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.777222    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"} err="failed to get container status \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": rpc error: code = NotFound desc = could not find container \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": container with ID starting with fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c not found: ID does not exist"
Oct 30 19:25:50.777250 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.777237    6015 scope.go:122] "RemoveContainer" containerID="30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"
Oct 30 19:25:50.777478 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:50.777459    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": container with ID starting with 30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56 not found: ID does not exist" containerID="30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"
Oct 30 19:25:50.777513 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.777483    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"} err="failed to get container status \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": rpc error: code = NotFound desc = could not find container \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": container with ID starting with 30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56 not found: ID does not exist"
Oct 30 19:25:50.777513 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.777495    6015 scope.go:122] "RemoveContainer" containerID="d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"
Oct 30 19:25:50.777679 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.777661    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"} err="failed to get container status \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": rpc error: code = NotFound desc = could not find container \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": container with ID starting with d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4 not found: ID does not exist"
Oct 30 19:25:50.777715 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.777680    6015 scope.go:122] "RemoveContainer" containerID="e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"
Oct 30 19:25:50.777926 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.777910    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"} err="failed to get container status \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": rpc error: code = NotFound desc = could not find container \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": container with ID starting with e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831 not found: ID does not exist"
Oct 30 19:25:50.777977 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.777925    6015 scope.go:122] "RemoveContainer" containerID="ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"
Oct 30 19:25:50.778144 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.778126    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"} err="failed to get container status \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": rpc error: code = NotFound desc = could not find container \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": container with ID starting with ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902 not found: ID does not exist"
Oct 30 19:25:50.778188 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.778144    6015 scope.go:122] "RemoveContainer" containerID="ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"
Oct 30 19:25:50.778341 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.778325    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"} err="failed to get container status \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": rpc error: code = NotFound desc = could not find container \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": container with ID starting with ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7 not found: ID does not exist"
Oct 30 19:25:50.778387 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.778341    6015 scope.go:122] "RemoveContainer" containerID="ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"
Oct 30 19:25:50.778531 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.778517    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"} err="failed to get container status \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": rpc error: code = NotFound desc = could not find container \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": container with ID starting with ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31 not found: ID does not exist"
Oct 30 19:25:50.778576 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.778531    6015 scope.go:122] "RemoveContainer" containerID="fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"
Oct 30 19:25:50.778730 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.778714    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"} err="failed to get container status \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": rpc error: code = NotFound desc = could not find container \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": container with ID starting with fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c not found: ID does not exist"
Oct 30 19:25:50.778766 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.778730    6015 scope.go:122] "RemoveContainer" containerID="30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"
Oct 30 19:25:50.778922 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.778908    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"} err="failed to get container status \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": rpc error: code = NotFound desc = could not find container \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": container with ID starting with 30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56 not found: ID does not exist"
Oct 30 19:25:50.778967 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.778922    6015 scope.go:122] "RemoveContainer" containerID="d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"
Oct 30 19:25:50.779110 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.779095    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"} err="failed to get container status \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": rpc error: code = NotFound desc = could not find container \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": container with ID starting with d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4 not found: ID does not exist"
Oct 30 19:25:50.779147 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.779110    6015 scope.go:122] "RemoveContainer" containerID="e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"
Oct 30 19:25:50.779285 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.779271    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"} err="failed to get container status \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": rpc error: code = NotFound desc = could not find container \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": container with ID starting with e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831 not found: ID does not exist"
Oct 30 19:25:50.779322 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.779287    6015 scope.go:122] "RemoveContainer" containerID="ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"
Oct 30 19:25:50.779474 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.779458    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"} err="failed to get container status \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": rpc error: code = NotFound desc = could not find container \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": container with ID starting with ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902 not found: ID does not exist"
Oct 30 19:25:50.779517 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.779474    6015 scope.go:122] "RemoveContainer" containerID="ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"
Oct 30 19:25:50.779667 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.779652    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"} err="failed to get container status \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": rpc error: code = NotFound desc = could not find container \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": container with ID starting with ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7 not found: ID does not exist"
Oct 30 19:25:50.779703 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.779667    6015 scope.go:122] "RemoveContainer" containerID="ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"
Oct 30 19:25:50.779892 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.779877    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"} err="failed to get container status \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": rpc error: code = NotFound desc = could not find container \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": container with ID starting with ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31 not found: ID does not exist"
Oct 30 19:25:50.779932 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.779892    6015 scope.go:122] "RemoveContainer" containerID="fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"
Oct 30 19:25:50.780134 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.780115    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"} err="failed to get container status \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": rpc error: code = NotFound desc = could not find container \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": container with ID starting with fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c not found: ID does not exist"
Oct 30 19:25:50.780186 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.780134    6015 scope.go:122] "RemoveContainer" containerID="30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"
Oct 30 19:25:50.780342 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.780326    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"} err="failed to get container status \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": rpc error: code = NotFound desc = could not find container \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": container with ID starting with 30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56 not found: ID does not exist"
Oct 30 19:25:50.780342 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.780341    6015 scope.go:122] "RemoveContainer" containerID="d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"
Oct 30 19:25:50.780554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.780538    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"} err="failed to get container status \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": rpc error: code = NotFound desc = could not find container \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": container with ID starting with d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4 not found: ID does not exist"
Oct 30 19:25:50.780591 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.780554    6015 scope.go:122] "RemoveContainer" containerID="e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"
Oct 30 19:25:50.780758 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.780741    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"} err="failed to get container status \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": rpc error: code = NotFound desc = could not find container \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": container with ID starting with e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831 not found: ID does not exist"
Oct 30 19:25:50.780758 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.780757    6015 scope.go:122] "RemoveContainer" containerID="ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"
Oct 30 19:25:50.780953 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.780934    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"} err="failed to get container status \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": rpc error: code = NotFound desc = could not find container \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": container with ID starting with ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902 not found: ID does not exist"
Oct 30 19:25:50.780990 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.780953    6015 scope.go:122] "RemoveContainer" containerID="ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"
Oct 30 19:25:50.781128 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.781108    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"} err="failed to get container status \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": rpc error: code = NotFound desc = could not find container \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": container with ID starting with ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7 not found: ID does not exist"
Oct 30 19:25:50.781128 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.781126    6015 scope.go:122] "RemoveContainer" containerID="ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"
Oct 30 19:25:50.781342 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.781328    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"} err="failed to get container status \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": rpc error: code = NotFound desc = could not find container \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": container with ID starting with ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31 not found: ID does not exist"
Oct 30 19:25:50.781383 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.781342    6015 scope.go:122] "RemoveContainer" containerID="fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"
Oct 30 19:25:50.781540 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.781517    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"} err="failed to get container status \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": rpc error: code = NotFound desc = could not find container \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": container with ID starting with fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c not found: ID does not exist"
Oct 30 19:25:50.781574 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.781540    6015 scope.go:122] "RemoveContainer" containerID="30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"
Oct 30 19:25:50.781787 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.781770    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"} err="failed to get container status \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": rpc error: code = NotFound desc = could not find container \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": container with ID starting with 30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56 not found: ID does not exist"
Oct 30 19:25:50.781846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.781788    6015 scope.go:122] "RemoveContainer" containerID="d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"
Oct 30 19:25:50.782004 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.781988    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"} err="failed to get container status \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": rpc error: code = NotFound desc = could not find container \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": container with ID starting with d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4 not found: ID does not exist"
Oct 30 19:25:50.782044 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.782004    6015 scope.go:122] "RemoveContainer" containerID="e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"
Oct 30 19:25:50.782187 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.782171    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"} err="failed to get container status \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": rpc error: code = NotFound desc = could not find container \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": container with ID starting with e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831 not found: ID does not exist"
Oct 30 19:25:50.782187 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.782187    6015 scope.go:122] "RemoveContainer" containerID="ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"
Oct 30 19:25:50.782376 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.782351    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"} err="failed to get container status \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": rpc error: code = NotFound desc = could not find container \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": container with ID starting with ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902 not found: ID does not exist"
Oct 30 19:25:50.782376 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.782368    6015 scope.go:122] "RemoveContainer" containerID="ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"
Oct 30 19:25:50.782583 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.782554    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"} err="failed to get container status \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": rpc error: code = NotFound desc = could not find container \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": container with ID starting with ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7 not found: ID does not exist"
Oct 30 19:25:50.782583 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.782574    6015 scope.go:122] "RemoveContainer" containerID="ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"
Oct 30 19:25:50.782792 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.782777    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"} err="failed to get container status \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": rpc error: code = NotFound desc = could not find container \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": container with ID starting with ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31 not found: ID does not exist"
Oct 30 19:25:50.782862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.782791    6015 scope.go:122] "RemoveContainer" containerID="fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"
Oct 30 19:25:50.783015 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.783001    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"} err="failed to get container status \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": rpc error: code = NotFound desc = could not find container \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": container with ID starting with fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c not found: ID does not exist"
Oct 30 19:25:50.783052 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.783016    6015 scope.go:122] "RemoveContainer" containerID="30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"
Oct 30 19:25:50.783206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.783189    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"} err="failed to get container status \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": rpc error: code = NotFound desc = could not find container \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": container with ID starting with 30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56 not found: ID does not exist"
Oct 30 19:25:50.783255 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.783207    6015 scope.go:122] "RemoveContainer" containerID="d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"
Oct 30 19:25:50.783416 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.783396    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4"} err="failed to get container status \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": rpc error: code = NotFound desc = could not find container \"d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4\": container with ID starting with d6af2f3e3ec81a4f6a42301f71f6554ae9ac4adca70f98968b6bf9c9ebfd8bf4 not found: ID does not exist"
Oct 30 19:25:50.783479 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.783416    6015 scope.go:122] "RemoveContainer" containerID="e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"
Oct 30 19:25:50.783664 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.783641    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831"} err="failed to get container status \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": rpc error: code = NotFound desc = could not find container \"e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831\": container with ID starting with e93a4aa932a16832dca575f07d5c2ac65eeae9d4245671a658aa437e2fed0831 not found: ID does not exist"
Oct 30 19:25:50.783664 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.783665    6015 scope.go:122] "RemoveContainer" containerID="ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"
Oct 30 19:25:50.783897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.783868    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902"} err="failed to get container status \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": rpc error: code = NotFound desc = could not find container \"ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902\": container with ID starting with ff1f7b1016c386f92cca3acf55bcee78f41faf094b5a5931e27a8b4f92cd9902 not found: ID does not exist"
Oct 30 19:25:50.783969 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.783908    6015 scope.go:122] "RemoveContainer" containerID="ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"
Oct 30 19:25:50.784152 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.784132    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7"} err="failed to get container status \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": rpc error: code = NotFound desc = could not find container \"ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7\": container with ID starting with ddcf53d6b7bd0b9ccd422d026e3ade72df80651ea69005bb74b3213c9513f8d7 not found: ID does not exist"
Oct 30 19:25:50.784207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.784152    6015 scope.go:122] "RemoveContainer" containerID="ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"
Oct 30 19:25:50.784367 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.784349    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31"} err="failed to get container status \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": rpc error: code = NotFound desc = could not find container \"ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31\": container with ID starting with ef5c22a532f1ad144a015d5496433980a548efd9eaee3c7ecce6b9b521d58a31 not found: ID does not exist"
Oct 30 19:25:50.784428 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.784369    6015 scope.go:122] "RemoveContainer" containerID="fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"
Oct 30 19:25:50.784576 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.784559    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c"} err="failed to get container status \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": rpc error: code = NotFound desc = could not find container \"fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c\": container with ID starting with fbeb2b9caebc41c935b3be27f085cc0089c769947be6519408a08174d25c642c not found: ID does not exist"
Oct 30 19:25:50.784576 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.784573    6015 scope.go:122] "RemoveContainer" containerID="30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"
Oct 30 19:25:50.784831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.784791    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56"} err="failed to get container status \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": rpc error: code = NotFound desc = could not find container \"30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56\": container with ID starting with 30bf6568d2efd4d01d890ab7d93d8b1c59b083105f10553c5d3b8b861b3c6a56 not found: ID does not exist"
Oct 30 19:25:50.874853 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.874820    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:25:50.922559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.921858    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:25:50.922559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.922444    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:25:50.922915 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.922885    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="alertmanager"
Oct 30 19:25:50.922915 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.922904    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="alertmanager"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.922931    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.922938    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.922965    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy-metric"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.922973    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy-metric"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.922992    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy-web"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.922999    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy-web"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923008    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="config-reloader"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923015    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="config-reloader"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923031    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="prom-label-proxy"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923038    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="prom-label-proxy"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923049    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="init-config-reloader"
Oct 30 19:25:50.923051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923055    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="init-config-reloader"
Oct 30 19:25:50.923596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923129    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy-metric"
Oct 30 19:25:50.923596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923145    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy-web"
Oct 30 19:25:50.923596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923154    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="config-reloader"
Oct 30 19:25:50.923596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923165    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="prom-label-proxy"
Oct 30 19:25:50.923596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923171    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="init-config-reloader"
Oct 30 19:25:50.923596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923180    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="alertmanager"
Oct 30 19:25:50.923596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.923189    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" containerName="kube-rbac-proxy"
Oct 30 19:25:50.954180 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:50.954140    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.010883 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.010841    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 19:25:51.010883 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.010881    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 19:25:51.011088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.010908    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 19:25:51.011088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.010881    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 19:25:51.011088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.010913    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 19:25:51.011088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.010915    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-stvjk\""
Oct 30 19:25:51.011088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.010914    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 19:25:51.011088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.010926    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 19:25:51.011293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.011132    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 19:25:51.057726 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.057685    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66c776c2-e010-4b9b-a18e-dda1140e60d7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.057726 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.057723    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.058038 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.057745    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.058038 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.057885    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66c776c2-e010-4b9b-a18e-dda1140e60d7-config-out\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.058038 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.057947    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.058038 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.057960    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 19:25:51.058038 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.057997    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-config-volume\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.058293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.058070    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8txp\" (UniqueName: \"kubernetes.io/projected/66c776c2-e010-4b9b-a18e-dda1140e60d7-kube-api-access-j8txp\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.058293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.058101    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-web-config\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.058293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.058139    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66c776c2-e010-4b9b-a18e-dda1140e60d7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.058293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.058178    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.058293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.058207    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66c776c2-e010-4b9b-a18e-dda1140e60d7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.058293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.058273    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66c776c2-e010-4b9b-a18e-dda1140e60d7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.058493 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.058309    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.159471 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159433    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.159471 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159474    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66c776c2-e010-4b9b-a18e-dda1140e60d7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.159710 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159509    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66c776c2-e010-4b9b-a18e-dda1140e60d7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.159710 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159528    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.159710 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159573    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66c776c2-e010-4b9b-a18e-dda1140e60d7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.159710 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159601    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.159939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159724    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.159939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159773    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66c776c2-e010-4b9b-a18e-dda1140e60d7-config-out\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.159939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159848    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.159939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159879    6015 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 19:25:51.159939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159905    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-config-volume\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.160182 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159942    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8txp\" (UniqueName: \"kubernetes.io/projected/66c776c2-e010-4b9b-a18e-dda1140e60d7-kube-api-access-j8txp\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.160182 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.159976    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-web-config\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.160182 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.160019    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66c776c2-e010-4b9b-a18e-dda1140e60d7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.160182 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.160119    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66c776c2-e010-4b9b-a18e-dda1140e60d7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.160797 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.160615    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66c776c2-e010-4b9b-a18e-dda1140e60d7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.161058 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.160870    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66c776c2-e010-4b9b-a18e-dda1140e60d7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.162858 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.162792    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66c776c2-e010-4b9b-a18e-dda1140e60d7-config-out\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.162858 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.162823    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.162996 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.162968    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.163475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.163447    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.163579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.163558    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66c776c2-e010-4b9b-a18e-dda1140e60d7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.163629 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.163588    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-config-volume\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.163727 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.163713    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-web-config\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.164076 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.164060    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.165268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.165253    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66c776c2-e010-4b9b-a18e-dda1140e60d7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.169396 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.169374    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:25:51.223950 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.223878    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8txp\" (UniqueName: \"kubernetes.io/projected/66c776c2-e010-4b9b-a18e-dda1140e60d7-kube-api-access-j8txp\") pod \"alertmanager-main-0\" (UID: \"66c776c2-e010-4b9b-a18e-dda1140e60d7\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.352276 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.352242    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:51.389886 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.389850    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 19:25:51.503181 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.503150    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:25:51.504782 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.504748    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:51.584067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.583839    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ab4c499-e0ea-4f67-b673-c2f8957d06ac" path="/var/lib/kubelet/pods/5ab4c499-e0ea-4f67-b673-c2f8957d06ac/volumes"
Oct 30 19:25:51.853999 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:51.853962    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 19:25:51.860506 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:51.860461    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c776c2_e010_4b9b_a18e_dda1140e60d7.slice/crio-21be04e0d95da235140e0ec21d4fbf97fe535b33f91981f5f2b40acf54d341c7 WatchSource:0}: Error finding container 21be04e0d95da235140e0ec21d4fbf97fe535b33f91981f5f2b40acf54d341c7: Status 404 returned error can't find the container with id 21be04e0d95da235140e0ec21d4fbf97fe535b33f91981f5f2b40acf54d341c7
Oct 30 19:25:52.726018 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:52.725982    6015 generic.go:356] "Generic (PLEG): container finished" podID="66c776c2-e010-4b9b-a18e-dda1140e60d7" containerID="b23d7934645fec51536f0d28a11c7b24115727e9833afd54e54ade906e90240f" exitCode=0
Oct 30 19:25:52.726194 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:52.726070    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66c776c2-e010-4b9b-a18e-dda1140e60d7","Type":"ContainerDied","Data":"b23d7934645fec51536f0d28a11c7b24115727e9833afd54e54ade906e90240f"}
Oct 30 19:25:52.726194 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:52.726146    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66c776c2-e010-4b9b-a18e-dda1140e60d7","Type":"ContainerStarted","Data":"21be04e0d95da235140e0ec21d4fbf97fe535b33f91981f5f2b40acf54d341c7"}
Oct 30 19:25:53.038202 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:53.038170    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4nbnr"
Oct 30 19:25:53.733200 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:53.733165    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66c776c2-e010-4b9b-a18e-dda1140e60d7","Type":"ContainerStarted","Data":"142aeb2267f6a629ab00aa0730824dfae3958cdbddee3bbd3168fbe49d078958"}
Oct 30 19:25:53.733478 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:53.733229    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66c776c2-e010-4b9b-a18e-dda1140e60d7","Type":"ContainerStarted","Data":"babffd341512be5f9f6d23c3bbc65165858545fdc960fe3b1eea5dc4df9033de"}
Oct 30 19:25:53.733478 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:53.733256    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66c776c2-e010-4b9b-a18e-dda1140e60d7","Type":"ContainerStarted","Data":"609e0cb6612b781df5436ce15bcbfdaa808777cd82df867ac3e2c417e13885a3"}
Oct 30 19:25:53.733478 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:53.733285    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66c776c2-e010-4b9b-a18e-dda1140e60d7","Type":"ContainerStarted","Data":"3d0baa28230e14df597693268e071b687946ca75448303eb0f66be4168799ec2"}
Oct 30 19:25:53.733478 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:53.733309    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66c776c2-e010-4b9b-a18e-dda1140e60d7","Type":"ContainerStarted","Data":"a16f346d91e0d329e758e10f35234c496c6659760bfd47bd27515f19ac1ce179"}
Oct 30 19:25:53.733478 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:53.733332    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66c776c2-e010-4b9b-a18e-dda1140e60d7","Type":"ContainerStarted","Data":"6a54e34f488645bae437bf824820bd66c6603f9941ddc22419208b065db62452"}
Oct 30 19:25:53.858135 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:53.858086    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.844080768 podStartE2EDuration="3.858072547s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.991779ms" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:53.857498799 +0000 UTC m=+16.400306071" watchObservedRunningTime="2026-10-30 19:25:53.858072547 +0000 UTC m=+16.400879811"
Oct 30 19:25:54.269585 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:54.269547    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:54.459168 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:54.459134    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:25:55.482447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.482414    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 19:25:55.482914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.482736    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="prometheus" containerID="cri-o://08c0d5510ae8c459daea916be962e56457a9d51cd891aea1671e0f2f6c66afee" gracePeriod=600
Oct 30 19:25:55.482914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.482749    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy" containerID="cri-o://429c3c4f1fd094c0b6642ac008c6da3907097e28876689308a4d9e34a41de9a0" gracePeriod=600
Oct 30 19:25:55.482914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.482759    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="thanos-sidecar" containerID="cri-o://8ae93931750ca265d49c16803e4af9f9d3c8a0d5a04eced20c73b598a9f41a35" gracePeriod=600
Oct 30 19:25:55.482914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.482793    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="config-reloader" containerID="cri-o://2e1fd745164112d2f7141031f7671ca74ba28709e0b3b4b4d83df0f5e2cc0836" gracePeriod=600
Oct 30 19:25:55.482914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.482833    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f931dfeff5289dca3a89cb2028373a3de37fe93d5cbfb1e06b1cb4dfbe008c0c" gracePeriod=600
Oct 30 19:25:55.482914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.482775    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy-web" containerID="cri-o://a9789abbb28eb399c90b5ac3382af04386d7c9b48da565ae3ff98e5b48f7e9cd" gracePeriod=600
Oct 30 19:25:55.745259 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745193    6015 generic.go:356] "Generic (PLEG): container finished" podID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerID="f931dfeff5289dca3a89cb2028373a3de37fe93d5cbfb1e06b1cb4dfbe008c0c" exitCode=0
Oct 30 19:25:55.745259 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745220    6015 generic.go:356] "Generic (PLEG): container finished" podID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerID="429c3c4f1fd094c0b6642ac008c6da3907097e28876689308a4d9e34a41de9a0" exitCode=0
Oct 30 19:25:55.745259 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745226    6015 generic.go:356] "Generic (PLEG): container finished" podID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerID="a9789abbb28eb399c90b5ac3382af04386d7c9b48da565ae3ff98e5b48f7e9cd" exitCode=0
Oct 30 19:25:55.745259 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745232    6015 generic.go:356] "Generic (PLEG): container finished" podID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerID="8ae93931750ca265d49c16803e4af9f9d3c8a0d5a04eced20c73b598a9f41a35" exitCode=0
Oct 30 19:25:55.745259 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745237    6015 generic.go:356] "Generic (PLEG): container finished" podID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerID="2e1fd745164112d2f7141031f7671ca74ba28709e0b3b4b4d83df0f5e2cc0836" exitCode=0
Oct 30 19:25:55.745259 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745243    6015 generic.go:356] "Generic (PLEG): container finished" podID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerID="08c0d5510ae8c459daea916be962e56457a9d51cd891aea1671e0f2f6c66afee" exitCode=0
Oct 30 19:25:55.745559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745265    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerDied","Data":"f931dfeff5289dca3a89cb2028373a3de37fe93d5cbfb1e06b1cb4dfbe008c0c"}
Oct 30 19:25:55.745559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745336    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerDied","Data":"429c3c4f1fd094c0b6642ac008c6da3907097e28876689308a4d9e34a41de9a0"}
Oct 30 19:25:55.745559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745371    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerDied","Data":"a9789abbb28eb399c90b5ac3382af04386d7c9b48da565ae3ff98e5b48f7e9cd"}
Oct 30 19:25:55.745559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745395    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerDied","Data":"8ae93931750ca265d49c16803e4af9f9d3c8a0d5a04eced20c73b598a9f41a35"}
Oct 30 19:25:55.745559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745418    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerDied","Data":"2e1fd745164112d2f7141031f7671ca74ba28709e0b3b4b4d83df0f5e2cc0836"}
Oct 30 19:25:55.745559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.745447    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerDied","Data":"08c0d5510ae8c459daea916be962e56457a9d51cd891aea1671e0f2f6c66afee"}
Oct 30 19:25:55.764069 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.764047    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:55.900455 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900425    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-1\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900473    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-trusted-ca-bundle\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900503    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-0\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900526    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-2\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900580    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-serving-certs-ca-bundle\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900610    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900634    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-thanos-prometheus-http-client-file\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900661    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-config\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900694    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-tls-assets\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-tls-assets\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900729    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900773    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-config-out\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-config-out\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900845    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-kube-api-access-wk7v4\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-kube-api-access-wk7v4\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900899    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-web-config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-web-config\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900911    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-1" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:25:55.900993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900919    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-trusted-ca-bundle" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:25:55.900993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900934    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-tls\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.900993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.900992    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-grpc-tls\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.901458 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.901020    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-metrics-client-certs\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.901458 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.901050    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-metrics-client-ca\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.901458 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.901056    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-2" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:25:55.901458 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.901085    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-db\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.901458 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.901120    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-kubelet-serving-ca-bundle\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.901458 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.901151    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-kube-rbac-proxy\") pod \"605f1852-7ec7-4c02-938a-6d654d7e70bc\" (UID: \"605f1852-7ec7-4c02-938a-6d654d7e70bc\") "
Oct 30 19:25:55.901458 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.901447    6015 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:55.901836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.901464    6015 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:55.901836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.901481    6015 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:55.901836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.901603    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-serving-certs-ca-bundle" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:25:55.903009 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.902149    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-0" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:25:55.903009 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.902609    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-metrics-client-ca" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:25:55.903205 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.903087    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-kubelet-serving-ca-bundle" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:25:55.904001 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.903664    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-db" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:25:55.904244 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.904215    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-thanos-sidecar-tls" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:55.905949 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.905909    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-config-out" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:25:55.906101 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.906076    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-grpc-tls" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:55.906175 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.906159    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-tls-assets" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:25:55.906420 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.906301    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-metrics-client-certs" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:55.906420 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.906386    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-kube-rbac-proxy" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:55.906837 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.906722    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-config" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:55.906837 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.906784    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-tls" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:55.907004 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.906983    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-kube-api-access-wk7v4" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "kube-api-access-wk7v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:25:55.907129 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.907099    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-kube-rbac-proxy-web" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:55.907217 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.907195    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-thanos-prometheus-http-client-file" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:55.918668 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:55.918637    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-web-config" pod "605f1852-7ec7-4c02-938a-6d654d7e70bc" (UID: "605f1852-7ec7-4c02-938a-6d654d7e70bc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:25:56.002686 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002600    6015 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.002686 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002632    6015 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.002686 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002643    6015 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.002686 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002653    6015 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.002686 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002663    6015 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-config\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.002686 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002672    6015 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-tls-assets\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.002686 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002682    6015 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.002686 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002693    6015 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-config-out\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.003067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002702    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk7v4\" (UniqueName: \"kubernetes.io/projected/605f1852-7ec7-4c02-938a-6d654d7e70bc-kube-api-access-wk7v4\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.003067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002710    6015 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-web-config\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.003067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002718    6015 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.003067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002726    6015 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-grpc-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.003067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002735    6015 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-metrics-client-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.003067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002744    6015 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-metrics-client-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.003067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002778    6015 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/605f1852-7ec7-4c02-938a-6d654d7e70bc-prometheus-k8s-db\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.003067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002788    6015 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/605f1852-7ec7-4c02-938a-6d654d7e70bc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.003067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.002799    6015 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/605f1852-7ec7-4c02-938a-6d654d7e70bc-secret-kube-rbac-proxy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:25:56.752216 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.752130    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"605f1852-7ec7-4c02-938a-6d654d7e70bc","Type":"ContainerDied","Data":"5b868cbfc187e337b3b43a80e9eeb3d71b885dbcf9f37e65cf435a701400589d"}
Oct 30 19:25:56.752216 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.752154    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:56.752216 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.752213    6015 scope.go:122] "RemoveContainer" containerID="f931dfeff5289dca3a89cb2028373a3de37fe93d5cbfb1e06b1cb4dfbe008c0c"
Oct 30 19:25:56.760603 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.760586    6015 scope.go:122] "RemoveContainer" containerID="429c3c4f1fd094c0b6642ac008c6da3907097e28876689308a4d9e34a41de9a0"
Oct 30 19:25:56.768482 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.768463    6015 scope.go:122] "RemoveContainer" containerID="a9789abbb28eb399c90b5ac3382af04386d7c9b48da565ae3ff98e5b48f7e9cd"
Oct 30 19:25:56.775916 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.775897    6015 scope.go:122] "RemoveContainer" containerID="8ae93931750ca265d49c16803e4af9f9d3c8a0d5a04eced20c73b598a9f41a35"
Oct 30 19:25:56.782875 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.782856    6015 scope.go:122] "RemoveContainer" containerID="2e1fd745164112d2f7141031f7671ca74ba28709e0b3b4b4d83df0f5e2cc0836"
Oct 30 19:25:56.790140 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.790113    6015 scope.go:122] "RemoveContainer" containerID="08c0d5510ae8c459daea916be962e56457a9d51cd891aea1671e0f2f6c66afee"
Oct 30 19:25:56.798304 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.798284    6015 scope.go:122] "RemoveContainer" containerID="ee5cd0214c4bf3bd48520aca619f9ffbe32b5c532c1d3e6cf0eeac0aff27e98e"
Oct 30 19:25:56.957938 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:56.957904    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 19:25:57.008829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.008715    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 19:25:57.009341 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009090    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 19:25:57.009639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009621    6015 cpu_manager.go:414] "containerMap: removing container" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="config-reloader"
Oct 30 19:25:57.009692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009640    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="config-reloader"
Oct 30 19:25:57.009692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009650    6015 cpu_manager.go:414] "containerMap: removing container" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="init-config-reloader"
Oct 30 19:25:57.009692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009655    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="init-config-reloader"
Oct 30 19:25:57.009692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009663    6015 cpu_manager.go:414] "containerMap: removing container" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy-thanos"
Oct 30 19:25:57.009692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009668    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy-thanos"
Oct 30 19:25:57.009692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009683    6015 cpu_manager.go:414] "containerMap: removing container" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="thanos-sidecar"
Oct 30 19:25:57.009692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009688    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="thanos-sidecar"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009700    6015 cpu_manager.go:414] "containerMap: removing container" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy-web"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009705    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy-web"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009720    6015 cpu_manager.go:414] "containerMap: removing container" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="prometheus"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009724    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="prometheus"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009731    6015 cpu_manager.go:414] "containerMap: removing container" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009736    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009779    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="prometheus"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009786    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009792    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="config-reloader"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009797    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="init-config-reloader"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009824    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy-thanos"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009834    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="thanos-sidecar"
Oct 30 19:25:57.009941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.009842    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" containerName="kube-rbac-proxy-web"
Oct 30 19:25:57.013910 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.013891    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.065004 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.064963    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 19:25:57.065004 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.064966    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 19:25:57.065370 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.065352    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 19:25:57.065481 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.065464    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 19:25:57.066378 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.066364    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 19:25:57.066533 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.066517    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 19:25:57.066595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.066551    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tg4xp\""
Oct 30 19:25:57.066595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.066558    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 19:25:57.066595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.066528    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 19:25:57.066595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.066588    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 19:25:57.066739 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.066574    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7ugdki2ohn280\""
Oct 30 19:25:57.066739 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.066601    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 19:25:57.066739 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.066612    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 19:25:57.066739 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.066605    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 19:25:57.111449 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111422    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-web-config\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111457    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111482    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111577    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111619    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111646    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 19:25:57.111752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111682    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111710    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8kcd\" (UniqueName: \"kubernetes.io/projected/093352f2-f461-49b8-9afb-a26e2e361a39-kube-api-access-m8kcd\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111732    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111953 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111756    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-config\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111953 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111780    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/093352f2-f461-49b8-9afb-a26e2e361a39-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111953 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111843    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111953 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111890    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/093352f2-f461-49b8-9afb-a26e2e361a39-config-out\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.111953 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111932    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.112116 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.111968    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.112116 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.112040    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.112116 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.112077    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.112116 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.112105    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.112244 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.112143    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.112244 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.112166    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.112244 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.112179    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.116955 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.116933    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 19:25:57.213474 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213437    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.213474 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213480    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.213748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213516    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-web-config\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.213748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213547    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.213748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213579    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.213748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213609    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.213748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213669    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.213748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213713    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.213748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213742    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8kcd\" (UniqueName: \"kubernetes.io/projected/093352f2-f461-49b8-9afb-a26e2e361a39-kube-api-access-m8kcd\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.214212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213773    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.214212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213842    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-config\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.214212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213872    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/093352f2-f461-49b8-9afb-a26e2e361a39-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.214212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213896    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.214212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213926    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/093352f2-f461-49b8-9afb-a26e2e361a39-config-out\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.214212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213954    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.214212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.213979    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.214212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.214009    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.214212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.214051    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.214212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.214085    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.214212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.214125    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.215162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.214377    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.215162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.214410    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.215162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.214462    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.215162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.214701    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.215595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.215571    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.215885 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.215862    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.216135 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.216109    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.217395 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.217352    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.217861 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.217798    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.218335 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.218313    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.219425 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.219056    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.219425 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.219154    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.219425 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.219386    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/093352f2-f461-49b8-9afb-a26e2e361a39-config-out\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.219425 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.219403    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/093352f2-f461-49b8-9afb-a26e2e361a39-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.219681 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.219439    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-config\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.220067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.220042    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-web-config\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.220598 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.220576    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.220662 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.220606    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/093352f2-f461-49b8-9afb-a26e2e361a39-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.220662 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.220628    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/093352f2-f461-49b8-9afb-a26e2e361a39-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.245314 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.245278    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 19:25:57.275998 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.275926    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8kcd\" (UniqueName: \"kubernetes.io/projected/093352f2-f461-49b8-9afb-a26e2e361a39-kube-api-access-m8kcd\") pod \"prometheus-k8s-0\" (UID: \"093352f2-f461-49b8-9afb-a26e2e361a39\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.340396 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.340356    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:25:57.581987 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.581952    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="605f1852-7ec7-4c02-938a-6d654d7e70bc" path="/var/lib/kubelet/pods/605f1852-7ec7-4c02-938a-6d654d7e70bc/volumes"
Oct 30 19:25:57.800556 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:57.800521    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 19:25:57.806869 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:25:57.806797    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093352f2_f461_49b8_9afb_a26e2e361a39.slice/crio-f9c2c685bf13d32f34546a19b225fd9e54a14d5740d5a9d4347f1c56d40220d4 WatchSource:0}: Error finding container f9c2c685bf13d32f34546a19b225fd9e54a14d5740d5a9d4347f1c56d40220d4: Status 404 returned error can't find the container with id f9c2c685bf13d32f34546a19b225fd9e54a14d5740d5a9d4347f1c56d40220d4
Oct 30 19:25:58.214984 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:25:58.214900    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:25:58.762178 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:58.762085    6015 generic.go:356] "Generic (PLEG): container finished" podID="093352f2-f461-49b8-9afb-a26e2e361a39" containerID="4b8b5beba2cec6ed689ac3f4b93e1da2a2a1a56060cef831c99964c904d87c93" exitCode=0
Oct 30 19:25:58.762178 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:58.762134    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"093352f2-f461-49b8-9afb-a26e2e361a39","Type":"ContainerDied","Data":"4b8b5beba2cec6ed689ac3f4b93e1da2a2a1a56060cef831c99964c904d87c93"}
Oct 30 19:25:58.762379 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:58.762186    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"093352f2-f461-49b8-9afb-a26e2e361a39","Type":"ContainerStarted","Data":"f9c2c685bf13d32f34546a19b225fd9e54a14d5740d5a9d4347f1c56d40220d4"}
Oct 30 19:25:59.769562 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:59.769524    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"093352f2-f461-49b8-9afb-a26e2e361a39","Type":"ContainerStarted","Data":"436271857ca1086086dafd24d30dfc1e4139fd536c6f304169b9bc1c242461e5"}
Oct 30 19:25:59.769988 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:59.769609    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"093352f2-f461-49b8-9afb-a26e2e361a39","Type":"ContainerStarted","Data":"7bf4c41a9ab6b996da630d70a85a6c33b458c6f088941748687e67fc39e08647"}
Oct 30 19:25:59.769988 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:59.769649    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"093352f2-f461-49b8-9afb-a26e2e361a39","Type":"ContainerStarted","Data":"2c601041298a79f497fd080e8af2a478818872278700fa308a6f4511956626cb"}
Oct 30 19:25:59.769988 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:59.769689    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"093352f2-f461-49b8-9afb-a26e2e361a39","Type":"ContainerStarted","Data":"1bc3ca052bf690d57e249df6d15fc102a6594130f73050133f9a4cc09ef4fcae"}
Oct 30 19:25:59.769988 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:59.769732    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"093352f2-f461-49b8-9afb-a26e2e361a39","Type":"ContainerStarted","Data":"f8f455e91ad1580a0a6966d3ff79d4447e40689ea99ba9c5732af69d2568be39"}
Oct 30 19:25:59.769988 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:59.769766    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"093352f2-f461-49b8-9afb-a26e2e361a39","Type":"ContainerStarted","Data":"e600bbb4ca2f03d81cb9a62041df253739ea410c3f0259080f5da8823f46fc0a"}
Oct 30 19:25:59.896952 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:25:59.896895    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.878709688 podStartE2EDuration="3.896879043s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.169355ms" isStatefulPod=false podCreationTimestamp="2026-10-30 19:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:25:59.896776744 +0000 UTC m=+22.439584031" watchObservedRunningTime="2026-10-30 19:25:59.896879043 +0000 UTC m=+22.439686309"
Oct 30 19:26:01.867755 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:01.867715    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbq4b"
Oct 30 19:26:01.957938 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:01.957901    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:26:02.109144 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:02.109109    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:26:02.340709 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:02.340678    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:26:06.347465 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:06.347422    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:26:06.543223 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:06.543185    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:26:08.018483 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.018423    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-c49cd799b-652dx" podUID="967c1b48-0633-4580-8075-ea41321e866b" containerName="console" containerID="cri-o://c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4" gracePeriod=15
Oct 30 19:26:08.272955 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.272891    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:26:08.427603 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.427570    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-serving-cert\") pod \"967c1b48-0633-4580-8075-ea41321e866b\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") "
Oct 30 19:26:08.427603 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.427608    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-oauth-config\") pod \"967c1b48-0633-4580-8075-ea41321e866b\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") "
Oct 30 19:26:08.427858 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.427653    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-service-ca\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-service-ca\") pod \"967c1b48-0633-4580-8075-ea41321e866b\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") "
Oct 30 19:26:08.427858 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.427708    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/967c1b48-0633-4580-8075-ea41321e866b-tmp\" (UniqueName: \"kubernetes.io/empty-dir/967c1b48-0633-4580-8075-ea41321e866b-tmp\") pod \"967c1b48-0633-4580-8075-ea41321e866b\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") "
Oct 30 19:26:08.427858 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.427748    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/967c1b48-0633-4580-8075-ea41321e866b-kube-api-access-nbxc8\" (UniqueName: \"kubernetes.io/projected/967c1b48-0633-4580-8075-ea41321e866b-kube-api-access-nbxc8\") pod \"967c1b48-0633-4580-8075-ea41321e866b\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") "
Oct 30 19:26:08.427858 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.427782    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-trusted-ca-bundle\") pod \"967c1b48-0633-4580-8075-ea41321e866b\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") "
Oct 30 19:26:08.427858 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.427834    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-console-config\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-console-config\") pod \"967c1b48-0633-4580-8075-ea41321e866b\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") "
Oct 30 19:26:08.428115 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.427886    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-oauth-serving-cert\") pod \"967c1b48-0633-4580-8075-ea41321e866b\" (UID: \"967c1b48-0633-4580-8075-ea41321e866b\") "
Oct 30 19:26:08.428177 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.428136    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/967c1b48-0633-4580-8075-ea41321e866b-tmp" pod "967c1b48-0633-4580-8075-ea41321e866b" (UID: "967c1b48-0633-4580-8075-ea41321e866b"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:26:08.428225 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.428165    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-service-ca" pod "967c1b48-0633-4580-8075-ea41321e866b" (UID: "967c1b48-0633-4580-8075-ea41321e866b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:26:08.428524 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.428498    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-console-config" pod "967c1b48-0633-4580-8075-ea41321e866b" (UID: "967c1b48-0633-4580-8075-ea41321e866b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:26:08.428678 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.428655    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-oauth-serving-cert" pod "967c1b48-0633-4580-8075-ea41321e866b" (UID: "967c1b48-0633-4580-8075-ea41321e866b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:26:08.428723 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.428683    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-trusted-ca-bundle" pod "967c1b48-0633-4580-8075-ea41321e866b" (UID: "967c1b48-0633-4580-8075-ea41321e866b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:26:08.430339 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.430316    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-oauth-config" pod "967c1b48-0633-4580-8075-ea41321e866b" (UID: "967c1b48-0633-4580-8075-ea41321e866b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:26:08.430339 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.430329    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/967c1b48-0633-4580-8075-ea41321e866b-kube-api-access-nbxc8" pod "967c1b48-0633-4580-8075-ea41321e866b" (UID: "967c1b48-0633-4580-8075-ea41321e866b"). InnerVolumeSpecName "kube-api-access-nbxc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:26:08.430471 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.430389    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-serving-cert" pod "967c1b48-0633-4580-8075-ea41321e866b" (UID: "967c1b48-0633-4580-8075-ea41321e866b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:26:08.529079 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.529000    6015 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-oauth-serving-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:26:08.529079 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.529029    6015 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-serving-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:26:08.529079 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.529038    6015 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/967c1b48-0633-4580-8075-ea41321e866b-console-oauth-config\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:26:08.529079 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.529069    6015 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:26:08.529079 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.529079    6015 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/967c1b48-0633-4580-8075-ea41321e866b-tmp\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:26:08.529345 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.529090    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbxc8\" (UniqueName: \"kubernetes.io/projected/967c1b48-0633-4580-8075-ea41321e866b-kube-api-access-nbxc8\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:26:08.529345 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.529100    6015 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-trusted-ca-bundle\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:26:08.529345 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.529109    6015 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/967c1b48-0633-4580-8075-ea41321e866b-console-config\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:26:08.805388 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.805353    6015 generic.go:356] "Generic (PLEG): container finished" podID="967c1b48-0633-4580-8075-ea41321e866b" containerID="c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4" exitCode=0
Oct 30 19:26:08.805564 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.805398    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c49cd799b-652dx"
Oct 30 19:26:08.805564 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.805435    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c49cd799b-652dx" event={"ID":"967c1b48-0633-4580-8075-ea41321e866b","Type":"ContainerDied","Data":"c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4"}
Oct 30 19:26:08.805564 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.805488    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c49cd799b-652dx" event={"ID":"967c1b48-0633-4580-8075-ea41321e866b","Type":"ContainerDied","Data":"ac018828065099ab71a4aa616c89233e5b18ac7e177abefec61071267058dc9e"}
Oct 30 19:26:08.805564 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.805510    6015 scope.go:122] "RemoveContainer" containerID="c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4"
Oct 30 19:26:08.814050 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.814031    6015 scope.go:122] "RemoveContainer" containerID="c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4"
Oct 30 19:26:08.814338 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:26:08.814318    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4\": container with ID starting with c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4 not found: ID does not exist" containerID="c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4"
Oct 30 19:26:08.814432 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.814351    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4"} err="failed to get container status \"c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4\": rpc error: code = NotFound desc = could not find container \"c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4\": container with ID starting with c40edc8d69b17c00c1a67945fe68d63e1903acff1480faf191a032bfbcb1f9a4 not found: ID does not exist"
Oct 30 19:26:08.962571 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:08.962520    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c49cd799b-652dx"]
Oct 30 19:26:09.007889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:09.007852    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c49cd799b-652dx"]
Oct 30 19:26:09.582355 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:09.582319    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="967c1b48-0633-4580-8075-ea41321e866b" path="/var/lib/kubelet/pods/967c1b48-0633-4580-8075-ea41321e866b/volumes"
Oct 30 19:26:09.701877 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:09.701849    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:26:09.718297 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:09.718264    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:26:09.826461 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:09.826437    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 19:26:11.508934 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:11.508898    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:26:11.512905 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:11.512884    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56bf65fd49-dp7vl"
Oct 30 19:26:11.859489 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:11.859459    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q9pln"
Oct 30 19:26:28.214265 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:26:28.214227    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:26:35.935889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:35.935847    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:26:38.660539 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:26:38.660500    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:26:58.214217 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:26:58.214178    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:27:21.695538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:27:21.695501    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:27:28.214328 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:27:28.214277    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:27:38.978500 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:27:38.978459    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:27:58.213150 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:27:58.213112    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:28:28.213888 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:28:28.213851    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:28:28.444742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:28:28.444706    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:28:28.664610 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:28:28.664576    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:28:39.328751 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:28:39.328717    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:28:51.388839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:28:51.388740    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:28:51.552419 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:28:51.552359    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:28:58.214620 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:28:58.214581    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:29:28.214270 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:29:28.214225    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:29:39.702071 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:29:39.702038    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:29:58.213747 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:29:58.213709    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:30:28.214323 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:30:28.214283    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:30:40.068614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:30:40.068568    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:30:58.214230 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:30:58.214191    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:31:19.113875 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:19.113835    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:19.406608 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:19.406526    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:19.594967 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:19.594932    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:21.129932 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:21.129888    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:21.291689 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:21.291640    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:22.709559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:22.709520    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:23.684173 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:23.684137    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:23.888612 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:23.888576    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:27.651221 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:27.651188    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:27.848038 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:27.847992    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:28.215460 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:31:28.215427    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:31:28.243967 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:28.243936    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:28.417467 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:28.417430    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:28.623628 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:28.623598    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:28.937993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:28.937897    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:32.167010 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:32.166980    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:34.416904 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:34.416870    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:34.612656 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:34.612612    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:40.392739 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:40.392699    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:58.214684 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:31:58.214646    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:31:59.639473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:59.639437    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:31:59.995190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:31:59.995090    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:00.238094 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.238029    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:00.400161 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.400128    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:00.559491 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.559446    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:00.811297 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.811255    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"]
Oct 30 19:32:00.811796 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.811766    6015 cpu_manager.go:414] "containerMap: removing container" podUID="967c1b48-0633-4580-8075-ea41321e866b" containerName="console"
Oct 30 19:32:00.811796 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.811783    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="967c1b48-0633-4580-8075-ea41321e866b" containerName="console"
Oct 30 19:32:00.811964 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.811873    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="967c1b48-0633-4580-8075-ea41321e866b" containerName="console"
Oct 30 19:32:00.814058 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.814036    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:00.914044 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.914003    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2tfx\" (UniqueName: \"kubernetes.io/projected/76b8b0a4-f288-4981-9227-741532e407c8-kube-api-access-j2tfx\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:00.914044 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.914052    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76b8b0a4-f288-4981-9227-741532e407c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:00.914275 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.914148    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76b8b0a4-f288-4981-9227-741532e407c8-manifests\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:00.914275 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.914193    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/76b8b0a4-f288-4981-9227-741532e407c8-metrics-cert\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:00.914275 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.914253    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76b8b0a4-f288-4981-9227-741532e407c8-tmp\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:00.914398 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.914296    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76b8b0a4-f288-4981-9227-741532e407c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:00.916824 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.916792    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"]
Oct 30 19:32:00.944706 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.944677    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 19:32:00.945100 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.945073    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 19:32:00.945259 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.945236    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 19:32:00.945328 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.945260    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-dvbx8\""
Oct 30 19:32:00.945328 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.945268    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 19:32:00.945328 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:00.945247    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 19:32:01.015001 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.014955    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2tfx\" (UniqueName: \"kubernetes.io/projected/76b8b0a4-f288-4981-9227-741532e407c8-kube-api-access-j2tfx\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.015207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.015013    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76b8b0a4-f288-4981-9227-741532e407c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.015207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.015056    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76b8b0a4-f288-4981-9227-741532e407c8-manifests\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.015207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.015085    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/76b8b0a4-f288-4981-9227-741532e407c8-metrics-cert\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.015207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.015112    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76b8b0a4-f288-4981-9227-741532e407c8-tmp\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.015207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.015140    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76b8b0a4-f288-4981-9227-741532e407c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.015488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.015465    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76b8b0a4-f288-4981-9227-741532e407c8-manifests\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.017753 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.017715    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76b8b0a4-f288-4981-9227-741532e407c8-tmp\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.017927 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.017906    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/76b8b0a4-f288-4981-9227-741532e407c8-metrics-cert\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.017968 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.017912    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76b8b0a4-f288-4981-9227-741532e407c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.017968 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.017954    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76b8b0a4-f288-4981-9227-741532e407c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.030144 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.030117    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:01.073730 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.073656    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2tfx\" (UniqueName: \"kubernetes.io/projected/76b8b0a4-f288-4981-9227-741532e407c8-kube-api-access-j2tfx\") pod \"opendatahub-operator-controller-manager-f84ddd5d6-plb6z\" (UID: \"76b8b0a4-f288-4981-9227-741532e407c8\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.127011 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.126969    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:01.233991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.233953    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:01.471921 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.471833    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:01.626699 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.626672    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"]
Oct 30 19:32:01.630153 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:32:01.630129    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b8b0a4_f288_4981_9227_741532e407c8.slice/crio-4e4d13b84866f2286d28a06fb4bee53badf86689432244fd7defd0e362cb2e1f WatchSource:0}: Error finding container 4e4d13b84866f2286d28a06fb4bee53badf86689432244fd7defd0e362cb2e1f: Status 404 returned error can't find the container with id 4e4d13b84866f2286d28a06fb4bee53badf86689432244fd7defd0e362cb2e1f
Oct 30 19:32:01.631786 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:01.631766    6015 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:32:02.120049 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:02.120014    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z" event={"ID":"76b8b0a4-f288-4981-9227-741532e407c8","Type":"ContainerStarted","Data":"4e4d13b84866f2286d28a06fb4bee53badf86689432244fd7defd0e362cb2e1f"}
Oct 30 19:32:03.395065 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:03.395013    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:03.563681 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:03.563640    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:06.139341 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:06.139300    6015 generic.go:356] "Generic (PLEG): container finished" podID="76b8b0a4-f288-4981-9227-741532e407c8" containerID="f55eae054f515e8764158b5cd9003b9a9c00639d4d034a51fca105cd77e74420" exitCode=0
Oct 30 19:32:06.139859 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:06.139374    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z" event={"ID":"76b8b0a4-f288-4981-9227-741532e407c8","Type":"ContainerDied","Data":"f55eae054f515e8764158b5cd9003b9a9c00639d4d034a51fca105cd77e74420"}
Oct 30 19:32:07.147765 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:07.147731    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z" event={"ID":"76b8b0a4-f288-4981-9227-741532e407c8","Type":"ContainerStarted","Data":"6a6297f16e989e93a607ffe719a755369ef5e9d26eac7d31e1b71a7afad3710e"}
Oct 30 19:32:07.148200 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:07.147856    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:07.285976 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:07.285881    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:07.377460 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:07.377408    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z" podStartSLOduration=2.409618393 podStartE2EDuration="7.377394332s" totalImagesPullingTime="4.492440628s" totalInitContainerRuntime="475.335311ms" isStatefulPod=false podCreationTimestamp="2026-10-30 19:32:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:32:07.330652583 +0000 UTC m=+389.873459847" watchObservedRunningTime="2026-10-30 19:32:07.377394332 +0000 UTC m=+389.920201591"
Oct 30 19:32:08.370069 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:08.370030    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:08.557852 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:08.557788    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:13.576910 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:13.576865    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:14.630905 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:14.630862    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:15.116280 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:15.116243    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:15.328398 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:15.328353    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:15.888222 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:15.888188    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:15.909035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:15.909002    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"]
Oct 30 19:32:15.915654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:15.915632    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"
Oct 30 19:32:16.013379 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.013333    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 19:32:16.013379 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.013337    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lzlz6\""
Oct 30 19:32:16.013599 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.013390    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 19:32:16.014161 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.014143    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"]
Oct 30 19:32:16.056456 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.056410    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjz6g\" (UniqueName: \"kubernetes.io/projected/6227dcf1-94b7-4884-b875-684d2630511d-kube-api-access-zjz6g\") pod \"cert-manager-webhook-5dbbbf75cc-sn9t5\" (UID: \"6227dcf1-94b7-4884-b875-684d2630511d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"
Oct 30 19:32:16.056642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.056548    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6227dcf1-94b7-4884-b875-684d2630511d-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-sn9t5\" (UID: \"6227dcf1-94b7-4884-b875-684d2630511d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"
Oct 30 19:32:16.157600 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.157511    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6227dcf1-94b7-4884-b875-684d2630511d-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-sn9t5\" (UID: \"6227dcf1-94b7-4884-b875-684d2630511d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"
Oct 30 19:32:16.157600 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.157581    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjz6g\" (UniqueName: \"kubernetes.io/projected/6227dcf1-94b7-4884-b875-684d2630511d-kube-api-access-zjz6g\") pod \"cert-manager-webhook-5dbbbf75cc-sn9t5\" (UID: \"6227dcf1-94b7-4884-b875-684d2630511d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"
Oct 30 19:32:16.216388 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.216354    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjz6g\" (UniqueName: \"kubernetes.io/projected/6227dcf1-94b7-4884-b875-684d2630511d-kube-api-access-zjz6g\") pod \"cert-manager-webhook-5dbbbf75cc-sn9t5\" (UID: \"6227dcf1-94b7-4884-b875-684d2630511d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"
Oct 30 19:32:16.216896 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.216872    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6227dcf1-94b7-4884-b875-684d2630511d-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-sn9t5\" (UID: \"6227dcf1-94b7-4884-b875-684d2630511d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"
Oct 30 19:32:16.237638 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.237609    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"
Oct 30 19:32:16.607617 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.607585    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"]
Oct 30 19:32:16.614357 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:32:16.614328    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6227dcf1_94b7_4884_b875_684d2630511d.slice/crio-1e1e1fb026eaae3e813dd6da90503c698bbe1f410e39f46f1208aa03178a1691 WatchSource:0}: Error finding container 1e1e1fb026eaae3e813dd6da90503c698bbe1f410e39f46f1208aa03178a1691: Status 404 returned error can't find the container with id 1e1e1fb026eaae3e813dd6da90503c698bbe1f410e39f46f1208aa03178a1691
Oct 30 19:32:16.856149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:16.856111    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:17.185762 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:17.185728    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5" event={"ID":"6227dcf1-94b7-4884-b875-684d2630511d","Type":"ContainerStarted","Data":"1e1e1fb026eaae3e813dd6da90503c698bbe1f410e39f46f1208aa03178a1691"}
Oct 30 19:32:17.742627 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:17.742594    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:17.852432 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:17.852402    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl"]
Oct 30 19:32:17.855986 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:17.855964    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl"
Oct 30 19:32:17.913318 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:17.913287    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl"]
Oct 30 19:32:17.958937 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:17.958908    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-989nq\""
Oct 30 19:32:17.974515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:17.974480    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/425125ca-4d38-48e6-8fb8-06b03b9f6e8a-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-gpmzl\" (UID: \"425125ca-4d38-48e6-8fb8-06b03b9f6e8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl"
Oct 30 19:32:17.974643 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:17.974630    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2ncs\" (UniqueName: \"kubernetes.io/projected/425125ca-4d38-48e6-8fb8-06b03b9f6e8a-kube-api-access-t2ncs\") pod \"cert-manager-cainjector-5c57bbd4fc-gpmzl\" (UID: \"425125ca-4d38-48e6-8fb8-06b03b9f6e8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl"
Oct 30 19:32:18.075206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:18.075157    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2ncs\" (UniqueName: \"kubernetes.io/projected/425125ca-4d38-48e6-8fb8-06b03b9f6e8a-kube-api-access-t2ncs\") pod \"cert-manager-cainjector-5c57bbd4fc-gpmzl\" (UID: \"425125ca-4d38-48e6-8fb8-06b03b9f6e8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl"
Oct 30 19:32:18.075400 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:18.075226    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/425125ca-4d38-48e6-8fb8-06b03b9f6e8a-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-gpmzl\" (UID: \"425125ca-4d38-48e6-8fb8-06b03b9f6e8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl"
Oct 30 19:32:18.134388 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:18.134358    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2ncs\" (UniqueName: \"kubernetes.io/projected/425125ca-4d38-48e6-8fb8-06b03b9f6e8a-kube-api-access-t2ncs\") pod \"cert-manager-cainjector-5c57bbd4fc-gpmzl\" (UID: \"425125ca-4d38-48e6-8fb8-06b03b9f6e8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl"
Oct 30 19:32:18.134581 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:18.134560    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/425125ca-4d38-48e6-8fb8-06b03b9f6e8a-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-gpmzl\" (UID: \"425125ca-4d38-48e6-8fb8-06b03b9f6e8a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl"
Oct 30 19:32:18.155909 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:18.155878    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f84ddd5d6-plb6z"
Oct 30 19:32:18.167948 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:18.167920    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl"
Oct 30 19:32:18.535943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:18.535855    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl"]
Oct 30 19:32:18.542968 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:32:18.542940    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod425125ca_4d38_48e6_8fb8_06b03b9f6e8a.slice/crio-e0ec56188518935a21b4b86b0ba638b7240ded2b323968e14d207421e3d59f1e WatchSource:0}: Error finding container e0ec56188518935a21b4b86b0ba638b7240ded2b323968e14d207421e3d59f1e: Status 404 returned error can't find the container with id e0ec56188518935a21b4b86b0ba638b7240ded2b323968e14d207421e3d59f1e
Oct 30 19:32:19.197034 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:19.196992    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl" event={"ID":"425125ca-4d38-48e6-8fb8-06b03b9f6e8a","Type":"ContainerStarted","Data":"e0ec56188518935a21b4b86b0ba638b7240ded2b323968e14d207421e3d59f1e"}
Oct 30 19:32:20.025566 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:20.025527    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:20.239920 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:20.239830    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:20.652853 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:20.645565    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:22.218907 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:22.218858    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl" event={"ID":"425125ca-4d38-48e6-8fb8-06b03b9f6e8a","Type":"ContainerStarted","Data":"be5bc277ffa3a6017b5ceb4ef9a60b8c98e7ad007823d932c6cec5e0efdf475e"}
Oct 30 19:32:22.220513 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:22.220483    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5" event={"ID":"6227dcf1-94b7-4884-b875-684d2630511d","Type":"ContainerStarted","Data":"56d008f7edbec2e92001a19dc44c18e3945657ab5faeeb7beb6a82a5fa83c11b"}
Oct 30 19:32:22.220633 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:22.220531    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"
Oct 30 19:32:22.328725 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:22.328674    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gpmzl" podStartSLOduration=2.414302605 podStartE2EDuration="5.328660563s" totalImagesPullingTime="2.914357958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:32:22.327864575 +0000 UTC m=+404.870671841" watchObservedRunningTime="2026-10-30 19:32:22.328660563 +0000 UTC m=+404.871467821"
Oct 30 19:32:22.444377 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:22.444316    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5" podStartSLOduration=2.7202726090000002 podStartE2EDuration="7.444299354s" totalImagesPullingTime="4.724026745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:32:22.442994558 +0000 UTC m=+404.985801825" watchObservedRunningTime="2026-10-30 19:32:22.444299354 +0000 UTC m=+404.987106618"
Oct 30 19:32:23.119788 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.119742    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:23.173958 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.173925    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c"]
Oct 30 19:32:23.177383 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.177362    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c"
Oct 30 19:32:23.274247 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.274207    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 30 19:32:23.274247 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.274235    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 30 19:32:23.274737 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.274648    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-p5dpg\""
Oct 30 19:32:23.275436 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.275416    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c"]
Oct 30 19:32:23.297113 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.297081    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:23.329579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.329542    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0639b25-4b4b-4af4-89f9-24af597b19f7-tmp\") pod \"jobset-operator-674cd59dc5-kkb9c\" (UID: \"b0639b25-4b4b-4af4-89f9-24af597b19f7\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c"
Oct 30 19:32:23.329871 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.329846    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shszm\" (UniqueName: \"kubernetes.io/projected/b0639b25-4b4b-4af4-89f9-24af597b19f7-kube-api-access-shszm\") pod \"jobset-operator-674cd59dc5-kkb9c\" (UID: \"b0639b25-4b4b-4af4-89f9-24af597b19f7\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c"
Oct 30 19:32:23.430993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.430900    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0639b25-4b4b-4af4-89f9-24af597b19f7-tmp\") pod \"jobset-operator-674cd59dc5-kkb9c\" (UID: \"b0639b25-4b4b-4af4-89f9-24af597b19f7\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c"
Oct 30 19:32:23.430993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.430956    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shszm\" (UniqueName: \"kubernetes.io/projected/b0639b25-4b4b-4af4-89f9-24af597b19f7-kube-api-access-shszm\") pod \"jobset-operator-674cd59dc5-kkb9c\" (UID: \"b0639b25-4b4b-4af4-89f9-24af597b19f7\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c"
Oct 30 19:32:23.431320 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.431300    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0639b25-4b4b-4af4-89f9-24af597b19f7-tmp\") pod \"jobset-operator-674cd59dc5-kkb9c\" (UID: \"b0639b25-4b4b-4af4-89f9-24af597b19f7\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c"
Oct 30 19:32:23.495908 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.495876    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shszm\" (UniqueName: \"kubernetes.io/projected/b0639b25-4b4b-4af4-89f9-24af597b19f7-kube-api-access-shszm\") pod \"jobset-operator-674cd59dc5-kkb9c\" (UID: \"b0639b25-4b4b-4af4-89f9-24af597b19f7\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c"
Oct 30 19:32:23.792092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:23.791998    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c"
Oct 30 19:32:24.165117 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:24.165083    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c"]
Oct 30 19:32:24.171872 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:32:24.171844    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0639b25_4b4b_4af4_89f9_24af597b19f7.slice/crio-3bfd48dc4bb6d3c63e1f4a3f15bdd3a6d880fe0cdd98d41add5d0514f5cb05ea WatchSource:0}: Error finding container 3bfd48dc4bb6d3c63e1f4a3f15bdd3a6d880fe0cdd98d41add5d0514f5cb05ea: Status 404 returned error can't find the container with id 3bfd48dc4bb6d3c63e1f4a3f15bdd3a6d880fe0cdd98d41add5d0514f5cb05ea
Oct 30 19:32:24.230225 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:24.230186    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c" event={"ID":"b0639b25-4b4b-4af4-89f9-24af597b19f7","Type":"ContainerStarted","Data":"3bfd48dc4bb6d3c63e1f4a3f15bdd3a6d880fe0cdd98d41add5d0514f5cb05ea"}
Oct 30 19:32:24.777882 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:24.777843    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:26.268120 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:26.268082    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:27.975211 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:27.975171    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:28.217991 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:32:28.217951    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:32:28.227333 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:28.227280    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sn9t5"
Oct 30 19:32:28.797778 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:28.797741    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:29.251868 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:29.251749    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c" event={"ID":"b0639b25-4b4b-4af4-89f9-24af597b19f7","Type":"ContainerStarted","Data":"952097745bba22aac6c650aee6a0a7294649aaef0f40b441d451c35025885382"}
Oct 30 19:32:29.367365 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:29.367313    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-kkb9c" podStartSLOduration=2.320758613 podStartE2EDuration="6.367298393s" totalImagesPullingTime="4.04653978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:32:29.36612824 +0000 UTC m=+411.908935517" watchObservedRunningTime="2026-10-30 19:32:29.367298393 +0000 UTC m=+411.910105657"
Oct 30 19:32:29.381090 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:29.381050    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:30.717830 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:30.717774    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:32.633700 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:32.633663    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:34.153434 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:34.153396    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:34.310832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:34.310782    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:35.588151 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:35.588111    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:35.770913 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:35.770885    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-shqvm"]
Oct 30 19:32:35.774527 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:35.774507    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-shqvm"
Oct 30 19:32:35.819270 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:35.819233    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:35.870487 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:35.870398    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ph4ch\""
Oct 30 19:32:35.871378 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:35.871355    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-shqvm"]
Oct 30 19:32:35.946327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:35.946296    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e13b3260-f20c-474a-abae-03da73ebf61b-bound-sa-token\") pod \"cert-manager-597b95cb84-shqvm\" (UID: \"e13b3260-f20c-474a-abae-03da73ebf61b\") " pod="cert-manager/cert-manager-597b95cb84-shqvm"
Oct 30 19:32:35.946327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:35.946334    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d5sg\" (UniqueName: \"kubernetes.io/projected/e13b3260-f20c-474a-abae-03da73ebf61b-kube-api-access-8d5sg\") pod \"cert-manager-597b95cb84-shqvm\" (UID: \"e13b3260-f20c-474a-abae-03da73ebf61b\") " pod="cert-manager/cert-manager-597b95cb84-shqvm"
Oct 30 19:32:36.000195 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:36.000160    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:36.047960 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:36.047924    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e13b3260-f20c-474a-abae-03da73ebf61b-bound-sa-token\") pod \"cert-manager-597b95cb84-shqvm\" (UID: \"e13b3260-f20c-474a-abae-03da73ebf61b\") " pod="cert-manager/cert-manager-597b95cb84-shqvm"
Oct 30 19:32:36.047960 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:36.047958    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d5sg\" (UniqueName: \"kubernetes.io/projected/e13b3260-f20c-474a-abae-03da73ebf61b-kube-api-access-8d5sg\") pod \"cert-manager-597b95cb84-shqvm\" (UID: \"e13b3260-f20c-474a-abae-03da73ebf61b\") " pod="cert-manager/cert-manager-597b95cb84-shqvm"
Oct 30 19:32:36.107623 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:36.107587    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e13b3260-f20c-474a-abae-03da73ebf61b-bound-sa-token\") pod \"cert-manager-597b95cb84-shqvm\" (UID: \"e13b3260-f20c-474a-abae-03da73ebf61b\") " pod="cert-manager/cert-manager-597b95cb84-shqvm"
Oct 30 19:32:36.107796 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:36.107683    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d5sg\" (UniqueName: \"kubernetes.io/projected/e13b3260-f20c-474a-abae-03da73ebf61b-kube-api-access-8d5sg\") pod \"cert-manager-597b95cb84-shqvm\" (UID: \"e13b3260-f20c-474a-abae-03da73ebf61b\") " pod="cert-manager/cert-manager-597b95cb84-shqvm"
Oct 30 19:32:36.171550 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:36.171458    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:36.385855 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:36.385779    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-shqvm"
Oct 30 19:32:36.758211 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:36.758129    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-shqvm"]
Oct 30 19:32:36.766178 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:32:36.766150    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode13b3260_f20c_474a_abae_03da73ebf61b.slice/crio-b25a5cdd89a362e482fd795af32fff96d6a1539d0cc7e35c7675f109e3020900 WatchSource:0}: Error finding container b25a5cdd89a362e482fd795af32fff96d6a1539d0cc7e35c7675f109e3020900: Status 404 returned error can't find the container with id b25a5cdd89a362e482fd795af32fff96d6a1539d0cc7e35c7675f109e3020900
Oct 30 19:32:37.285160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:37.285125    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-shqvm" event={"ID":"e13b3260-f20c-474a-abae-03da73ebf61b","Type":"ContainerStarted","Data":"8aae0a925a02c8f30f1448f22b85b7c51e9adff2632669b5375f62e0c77d1ffd"}
Oct 30 19:32:37.285160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:37.285166    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-shqvm" event={"ID":"e13b3260-f20c-474a-abae-03da73ebf61b","Type":"ContainerStarted","Data":"b25a5cdd89a362e482fd795af32fff96d6a1539d0cc7e35c7675f109e3020900"}
Oct 30 19:32:37.396880 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:37.396787    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-shqvm" podStartSLOduration=2.396767853 podStartE2EDuration="2.396767853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:32:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:32:37.396335215 +0000 UTC m=+419.939142482" watchObservedRunningTime="2026-10-30 19:32:37.396767853 +0000 UTC m=+419.939575119"
Oct 30 19:32:39.001545 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:39.001498    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:39.172111 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:39.172070    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:39.620852 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:39.620798    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:40.730855 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:40.730791    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:41.017795 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.017695    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:41.097172 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.097142    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"]
Oct 30 19:32:41.104132 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.104104    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"
Oct 30 19:32:41.162591 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.162557    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 19:32:41.162591 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.162591    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 19:32:41.172148 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.172107    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:41.196239 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.196201    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9319fb61-cad5-4b5d-83d1-71b1818c98e0-tmp\") pod \"kube-auth-proxy-5fc9b9cc5d-qz44t\" (UID: \"9319fb61-cad5-4b5d-83d1-71b1818c98e0\") " pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"
Oct 30 19:32:41.196404 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.196257    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mb68\" (UniqueName: \"kubernetes.io/projected/9319fb61-cad5-4b5d-83d1-71b1818c98e0-kube-api-access-5mb68\") pod \"kube-auth-proxy-5fc9b9cc5d-qz44t\" (UID: \"9319fb61-cad5-4b5d-83d1-71b1818c98e0\") " pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"
Oct 30 19:32:41.196404 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.196288    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9319fb61-cad5-4b5d-83d1-71b1818c98e0-tls-certs\") pod \"kube-auth-proxy-5fc9b9cc5d-qz44t\" (UID: \"9319fb61-cad5-4b5d-83d1-71b1818c98e0\") " pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"
Oct 30 19:32:41.204661 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.204625    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"]
Oct 30 19:32:41.250203 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.250160    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5mtsh\""
Oct 30 19:32:41.250203 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.250160    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 19:32:41.250203 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.250169    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 30 19:32:41.297566 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.297531    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9319fb61-cad5-4b5d-83d1-71b1818c98e0-tls-certs\") pod \"kube-auth-proxy-5fc9b9cc5d-qz44t\" (UID: \"9319fb61-cad5-4b5d-83d1-71b1818c98e0\") " pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"
Oct 30 19:32:41.297736 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.297598    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9319fb61-cad5-4b5d-83d1-71b1818c98e0-tmp\") pod \"kube-auth-proxy-5fc9b9cc5d-qz44t\" (UID: \"9319fb61-cad5-4b5d-83d1-71b1818c98e0\") " pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"
Oct 30 19:32:41.297736 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.297640    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mb68\" (UniqueName: \"kubernetes.io/projected/9319fb61-cad5-4b5d-83d1-71b1818c98e0-kube-api-access-5mb68\") pod \"kube-auth-proxy-5fc9b9cc5d-qz44t\" (UID: \"9319fb61-cad5-4b5d-83d1-71b1818c98e0\") " pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"
Oct 30 19:32:41.300341 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.300315    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9319fb61-cad5-4b5d-83d1-71b1818c98e0-tmp\") pod \"kube-auth-proxy-5fc9b9cc5d-qz44t\" (UID: \"9319fb61-cad5-4b5d-83d1-71b1818c98e0\") " pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"
Oct 30 19:32:41.300551 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.300531    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9319fb61-cad5-4b5d-83d1-71b1818c98e0-tls-certs\") pod \"kube-auth-proxy-5fc9b9cc5d-qz44t\" (UID: \"9319fb61-cad5-4b5d-83d1-71b1818c98e0\") " pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"
Oct 30 19:32:41.356120 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.356090    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mb68\" (UniqueName: \"kubernetes.io/projected/9319fb61-cad5-4b5d-83d1-71b1818c98e0-kube-api-access-5mb68\") pod \"kube-auth-proxy-5fc9b9cc5d-qz44t\" (UID: \"9319fb61-cad5-4b5d-83d1-71b1818c98e0\") " pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"
Oct 30 19:32:41.389628 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.389594    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:41.418610 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.418577    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"
Oct 30 19:32:41.550388 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.550265    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:41.703582 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.703549    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:41.790303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.790261    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t"]
Oct 30 19:32:41.796908 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:32:41.796879    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9319fb61_cad5_4b5d_83d1_71b1818c98e0.slice/crio-7368d49921a1148596a465c5870ba39b740bb6f2a71c0f51194b81758c604312 WatchSource:0}: Error finding container 7368d49921a1148596a465c5870ba39b740bb6f2a71c0f51194b81758c604312: Status 404 returned error can't find the container with id 7368d49921a1148596a465c5870ba39b740bb6f2a71c0f51194b81758c604312
Oct 30 19:32:41.976478 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:41.976378    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:42.143101 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:42.143059    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:42.311068 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:42.311038    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t" event={"ID":"9319fb61-cad5-4b5d-83d1-71b1818c98e0","Type":"ContainerStarted","Data":"7368d49921a1148596a465c5870ba39b740bb6f2a71c0f51194b81758c604312"}
Oct 30 19:32:44.716934 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.716896    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"]
Oct 30 19:32:44.720218 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.720188    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.726533 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.726441    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-cert\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.726533 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.726497    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-manager-config\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.726731 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.726591    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmxwh\" (UniqueName: \"kubernetes.io/projected/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-kube-api-access-rmxwh\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.726731 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.726646    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-metrics-certs\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.769527 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.769491    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Oct 30 19:32:44.817273 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.817249    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"]
Oct 30 19:32:44.822620 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.822595    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-gmnzc\""
Oct 30 19:32:44.822790 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.822626    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Oct 30 19:32:44.822790 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.822701    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Oct 30 19:32:44.827207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.827176    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-manager-config\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.827344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.827214    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmxwh\" (UniqueName: \"kubernetes.io/projected/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-kube-api-access-rmxwh\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.827344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.827270    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-metrics-certs\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.827344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.827342    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-cert\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.828182 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.828139    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-manager-config\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.830214 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.830193    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-cert\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.830685 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.830663    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-metrics-certs\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:44.886216 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:44.886189    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmxwh\" (UniqueName: \"kubernetes.io/projected/d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf-kube-api-access-rmxwh\") pod \"jobset-controller-manager-659b74b5cf-9s48t\" (UID: \"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf\") " pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:45.034235 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:45.034148    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:45.326937 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:45.326901    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t" event={"ID":"9319fb61-cad5-4b5d-83d1-71b1818c98e0","Type":"ContainerStarted","Data":"45f4672a532ba762830bedb09c445f2c247fad505afd5990b523aa32e799e751"}
Oct 30 19:32:45.438348 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:45.438276    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fc9b9cc5d-qz44t" podStartSLOduration=1.431920433 podStartE2EDuration="4.438262322s" totalImagesPullingTime="3.006341889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:32:45.437356706 +0000 UTC m=+427.980163970" watchObservedRunningTime="2026-10-30 19:32:45.438262322 +0000 UTC m=+427.981069586"
Oct 30 19:32:45.447444 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:45.447410    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"]
Oct 30 19:32:45.454065 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:32:45.454036    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f4bcd6_d25d_4b86_a1c4_34adbb8031bf.slice/crio-cabfeba27fe61c83ca18de7eb2ab56e4cceb29b341f51970d514283ea31e32a9 WatchSource:0}: Error finding container cabfeba27fe61c83ca18de7eb2ab56e4cceb29b341f51970d514283ea31e32a9: Status 404 returned error can't find the container with id cabfeba27fe61c83ca18de7eb2ab56e4cceb29b341f51970d514283ea31e32a9
Oct 30 19:32:45.513386 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:45.513345    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:45.724559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:45.724478    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:45.878682 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:45.878641    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:46.332103 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:46.332066    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t" event={"ID":"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf","Type":"ContainerStarted","Data":"cabfeba27fe61c83ca18de7eb2ab56e4cceb29b341f51970d514283ea31e32a9"}
Oct 30 19:32:47.090279 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:47.090229    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:47.278674 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:47.278637    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:47.473084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:47.472902    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:47.640246 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:47.640207    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:48.573372 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:48.573334    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:50.281710 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:50.281669    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:50.354354 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:50.354309    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t" event={"ID":"d1f4bcd6-d25d-4b86-a1c4-34adbb8031bf","Type":"ContainerStarted","Data":"ea3531867c66cc09a19df45802310b84195874ee43fb04555c463b08d1a3be64"}
Oct 30 19:32:50.354538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:50.354456    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:32:50.468101 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:50.468046    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t" podStartSLOduration=2.2533095850000002 podStartE2EDuration="6.468031348s" totalImagesPullingTime="4.214721763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:32:50.466877819 +0000 UTC m=+433.009685085" watchObservedRunningTime="2026-10-30 19:32:50.468031348 +0000 UTC m=+433.010838613"
Oct 30 19:32:50.494654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:50.494617    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:52.323180 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.323145    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"]
Oct 30 19:32:52.327771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.327753    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"
Oct 30 19:32:52.342589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.342430    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"]
Oct 30 19:32:52.387615 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.387582    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 19:32:52.387843 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.387617    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 19:32:52.387987 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.387753    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gmtfr\""
Oct 30 19:32:52.397979 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.397954    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qnvh\" (UniqueName: \"kubernetes.io/projected/153f2d0a-9487-484f-a0db-bde52c9e3d95-kube-api-access-5qnvh\") pod \"kuadrant-operator-controller-manager-678d87766f-mthrm\" (UID: \"153f2d0a-9487-484f-a0db-bde52c9e3d95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"
Oct 30 19:32:52.398132 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.398009    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/153f2d0a-9487-484f-a0db-bde52c9e3d95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-mthrm\" (UID: \"153f2d0a-9487-484f-a0db-bde52c9e3d95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"
Oct 30 19:32:52.499272 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.499230    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qnvh\" (UniqueName: \"kubernetes.io/projected/153f2d0a-9487-484f-a0db-bde52c9e3d95-kube-api-access-5qnvh\") pod \"kuadrant-operator-controller-manager-678d87766f-mthrm\" (UID: \"153f2d0a-9487-484f-a0db-bde52c9e3d95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"
Oct 30 19:32:52.499448 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.499295    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/153f2d0a-9487-484f-a0db-bde52c9e3d95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-mthrm\" (UID: \"153f2d0a-9487-484f-a0db-bde52c9e3d95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"
Oct 30 19:32:52.499673 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.499656    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/153f2d0a-9487-484f-a0db-bde52c9e3d95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-mthrm\" (UID: \"153f2d0a-9487-484f-a0db-bde52c9e3d95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"
Oct 30 19:32:52.559900 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.559862    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qnvh\" (UniqueName: \"kubernetes.io/projected/153f2d0a-9487-484f-a0db-bde52c9e3d95-kube-api-access-5qnvh\") pod \"kuadrant-operator-controller-manager-678d87766f-mthrm\" (UID: \"153f2d0a-9487-484f-a0db-bde52c9e3d95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"
Oct 30 19:32:52.640544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:52.640453    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"
Oct 30 19:32:53.116979 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:53.116945    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"]
Oct 30 19:32:53.123668 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:32:53.123636    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod153f2d0a_9487_484f_a0db_bde52c9e3d95.slice/crio-e487b84f2f0d3c8d22997532b189c2c76dc8e7398648222de8e02b34a654018c WatchSource:0}: Error finding container e487b84f2f0d3c8d22997532b189c2c76dc8e7398648222de8e02b34a654018c: Status 404 returned error can't find the container with id e487b84f2f0d3c8d22997532b189c2c76dc8e7398648222de8e02b34a654018c
Oct 30 19:32:53.370134 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:53.370048    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm" event={"ID":"153f2d0a-9487-484f-a0db-bde52c9e3d95","Type":"ContainerStarted","Data":"e487b84f2f0d3c8d22997532b189c2c76dc8e7398648222de8e02b34a654018c"}
Oct 30 19:32:54.023688 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:54.023649    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:54.176454 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:54.176417    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:32:58.219149 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:32:58.219115    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:32:58.398388 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:58.398354    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm" event={"ID":"153f2d0a-9487-484f-a0db-bde52c9e3d95","Type":"ContainerStarted","Data":"c782dd6dcb8b5f88ff69bcdeb052ac900518546f4b8cf98e9545b51c542d5ca0"}
Oct 30 19:32:58.398525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:58.398508    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"
Oct 30 19:32:58.606332 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:32:58.606265    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm" podStartSLOduration=1.452557477 podStartE2EDuration="6.60624963s" totalImagesPullingTime="5.153692153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:32:58.558694048 +0000 UTC m=+441.101501324" watchObservedRunningTime="2026-10-30 19:32:58.60624963 +0000 UTC m=+441.149056946"
Oct 30 19:33:01.364481 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:01.364450    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-659b74b5cf-9s48t"
Oct 30 19:33:09.404566 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:09.404535    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-mthrm"
Oct 30 19:33:11.860317 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:11.860286    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:12.014399 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:12.014361    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:12.642192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:12.642156    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:19.177455 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:19.177330    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:19.331965 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:19.331901    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:28.215794 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:33:28.215751    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:33:37.320716 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:37.320679    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:37.475119 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:37.475070    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:39.170901 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:39.170871    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:39.369985 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:39.369934    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:39.525583 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:39.525493    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:39.678981 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:39.678934    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:39.828421 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:39.828384    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:41.067059 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:41.067016    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:47.203293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:47.203261    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:47.587959 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:47.587856    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:50.713450 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:50.713400    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:51.012782 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:51.012685    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:58.218239 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:33:58.218192    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:33:59.399426 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:59.399387    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:59.558516 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:59.558478    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:59.722197 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:59.722114    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:33:59.871036 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:33:59.871004    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:00.033610 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:00.033518    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:00.191503 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:00.191464    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:00.441886 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:00.441846    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:00.593740 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:00.593709    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:01.818235 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:01.818200    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:07.110637 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:07.110599    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:07.305393 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:07.305351    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:07.460535 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:07.460453    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:07.612133 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:07.612093    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:07.766772 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:07.766670    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:07.915956 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:07.915913    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:08.073859 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:08.073825    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:08.229514 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:08.229480    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:08.377224 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:08.377148    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:20.841294 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:20.841251    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:21.059037 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:21.058995    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:22.146754 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:22.146713    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:22.295225 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:22.295179    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:22.885206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:22.885168    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:23.040201 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:23.040149    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:23.195177 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:23.195096    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:23.353409 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:23.353378    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:28.214596 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:34:28.214476    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:34:38.256931 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.256891    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:38.490317 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.490278    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:38.759842 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.759795    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"]
Oct 30 19:34:38.762416 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.762398    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:38.859532 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.859501    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-skrr4\""
Oct 30 19:34:38.859532 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.859503    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 19:34:38.859753 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.859502    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 19:34:38.859753 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.859505    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 19:34:38.859753 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.859662    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 19:34:38.860754 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.860735    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"]
Oct 30 19:34:38.933831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.923412    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c7458a-3ee5-486a-bd51-d7d231aa02d8-openshift-service-ca\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:38.933831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.923497    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60c7458a-3ee5-486a-bd51-d7d231aa02d8-metrics-certs\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:38.933831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.923579    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c7458a-3ee5-486a-bd51-d7d231aa02d8-maas-api-tls\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:38.933831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:38.923618    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8xms\" (UniqueName: \"kubernetes.io/projected/60c7458a-3ee5-486a-bd51-d7d231aa02d8-kube-api-access-d8xms\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:39.024310 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:39.024216    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c7458a-3ee5-486a-bd51-d7d231aa02d8-maas-api-tls\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:39.024310 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:39.024251    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8xms\" (UniqueName: \"kubernetes.io/projected/60c7458a-3ee5-486a-bd51-d7d231aa02d8-kube-api-access-d8xms\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:39.024512 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:39.024390    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c7458a-3ee5-486a-bd51-d7d231aa02d8-openshift-service-ca\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:39.024512 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:39.024448    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60c7458a-3ee5-486a-bd51-d7d231aa02d8-metrics-certs\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:39.025042 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:39.025017    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c7458a-3ee5-486a-bd51-d7d231aa02d8-openshift-service-ca\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:39.026911 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:39.026884    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60c7458a-3ee5-486a-bd51-d7d231aa02d8-metrics-certs\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:39.027029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:39.027010    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c7458a-3ee5-486a-bd51-d7d231aa02d8-maas-api-tls\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:39.087766 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:39.087728    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8xms\" (UniqueName: \"kubernetes.io/projected/60c7458a-3ee5-486a-bd51-d7d231aa02d8-kube-api-access-d8xms\") pod \"maas-api-6fdd445db4-vlfvk\" (UID: \"60c7458a-3ee5-486a-bd51-d7d231aa02d8\") " pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:39.374791 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:39.374746    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:39.741103 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:39.741023    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"]
Oct 30 19:34:39.744199 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:34:39.744173    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c7458a_3ee5_486a_bd51_d7d231aa02d8.slice/crio-cf2f08129f150883f2b8eeeb28a1529ea425644b4656c81d530bad9bd613f752 WatchSource:0}: Error finding container cf2f08129f150883f2b8eeeb28a1529ea425644b4656c81d530bad9bd613f752: Status 404 returned error can't find the container with id cf2f08129f150883f2b8eeeb28a1529ea425644b4656c81d530bad9bd613f752
Oct 30 19:34:39.845554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:39.845512    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk" event={"ID":"60c7458a-3ee5-486a-bd51-d7d231aa02d8","Type":"ContainerStarted","Data":"cf2f08129f150883f2b8eeeb28a1529ea425644b4656c81d530bad9bd613f752"}
Oct 30 19:34:41.418490 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:41.418451    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:42.282547 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:42.282507    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:34:42.864015 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:42.863982    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk" event={"ID":"60c7458a-3ee5-486a-bd51-d7d231aa02d8","Type":"ContainerStarted","Data":"5e4ec36b58694b97ec8e59b391840cd97d8667626d4c1cecd72385478ff0a2d0"}
Oct 30 19:34:42.864407 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:42.864046    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:43.020365 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:43.020261    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk" podStartSLOduration=2.134510973 podStartE2EDuration="5.020247177s" totalImagesPullingTime="2.885736204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:34:42.976710205 +0000 UTC m=+545.519517472" watchObservedRunningTime="2026-10-30 19:34:43.020247177 +0000 UTC m=+545.563054442"
Oct 30 19:34:48.873797 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:34:48.873708    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6fdd445db4-vlfvk"
Oct 30 19:34:58.213850 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:34:58.213790    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:35:28.214885 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:35:28.214844    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:35:35.297029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:35:35.296989    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:35:35.461727 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:35:35.461691    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:35:41.832480 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:35:41.832440    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:35:58.181605 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:35:58.181565    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:35:58.216379 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:35:58.216339    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:35:58.357550 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:35:58.357513    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:06.052428 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:06.052381    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:06.238185 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:06.238141    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:28.215240 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:36:28.215200    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:36:29.908629 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:29.908595    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:30.409849 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:30.409797    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:31.648354 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:31.648322    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:31.842541 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:31.842501    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:38.546133 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:38.546095    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:42.114724 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:42.114687    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:46.439338 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:46.439297    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:49.264785 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.264747    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"]
Oct 30 19:36:49.268230 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.268212    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.364183 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.364147    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 19:36:49.364183 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.364171    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 19:36:49.364183 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.364182    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-85qgn\""
Oct 30 19:36:49.364414 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.364213    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 30 19:36:49.365587 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.365569    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"]
Oct 30 19:36:49.372594 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.372559    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:49.408986 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.408956    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.409141 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.408993    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl8nm\" (UniqueName: \"kubernetes.io/projected/5516ade0-61c9-4e1d-97e7-19a3050d0b06-kube-api-access-pl8nm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.409141 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.409094    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5516ade0-61c9-4e1d-97e7-19a3050d0b06-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.409216 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.409138    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.409216 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.409189    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.409216 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.409212    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.510518 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.510477    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.510518 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.510521    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl8nm\" (UniqueName: \"kubernetes.io/projected/5516ade0-61c9-4e1d-97e7-19a3050d0b06-kube-api-access-pl8nm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.510785 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.510558    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5516ade0-61c9-4e1d-97e7-19a3050d0b06-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.510785 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.510595    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.510785 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.510621    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.510785 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.510644    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.511039 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.510994    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.511127 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.511106    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.511190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.511166    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.513088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.513068    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5516ade0-61c9-4e1d-97e7-19a3050d0b06-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.513315 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.513298    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5516ade0-61c9-4e1d-97e7-19a3050d0b06-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.568719 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.568681    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl8nm\" (UniqueName: \"kubernetes.io/projected/5516ade0-61c9-4e1d-97e7-19a3050d0b06-kube-api-access-pl8nm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-7q7rc\" (UID: \"5516ade0-61c9-4e1d-97e7-19a3050d0b06\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.580798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.580771    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:49.952092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:49.952019    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"]
Oct 30 19:36:49.955728 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:36:49.955701    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5516ade0_61c9_4e1d_97e7_19a3050d0b06.slice/crio-65ef1d04dde49c97d36eab4b68b357950ef8e7ede522f17b147e54ae1cb6a77b WatchSource:0}: Error finding container 65ef1d04dde49c97d36eab4b68b357950ef8e7ede522f17b147e54ae1cb6a77b: Status 404 returned error can't find the container with id 65ef1d04dde49c97d36eab4b68b357950ef8e7ede522f17b147e54ae1cb6a77b
Oct 30 19:36:50.439056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:50.439023    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc" event={"ID":"5516ade0-61c9-4e1d-97e7-19a3050d0b06","Type":"ContainerStarted","Data":"65ef1d04dde49c97d36eab4b68b357950ef8e7ede522f17b147e54ae1cb6a77b"}
Oct 30 19:36:52.267177 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:52.267144    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:52.451545 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:52.451512    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc" event={"ID":"5516ade0-61c9-4e1d-97e7-19a3050d0b06","Type":"ContainerStarted","Data":"03086093f558acbaf68847f63f81eb3d0c53b5c1ee6412ad06436ba02a4ce53f"}
Oct 30 19:36:52.566225 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:52.566169    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc" podStartSLOduration=1.966940407 podStartE2EDuration="3.5661538s" totalImagesPullingTime="1.599213393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:36:52.564706085 +0000 UTC m=+675.107513342" watchObservedRunningTime="2026-10-30 19:36:52.5661538 +0000 UTC m=+675.108961062"
Oct 30 19:36:52.581406 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:52.581376    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:55.906461 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:55.906429    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"]
Oct 30 19:36:55.910136 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:55.910117    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:55.971183 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:55.971132    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgjbc\" (UniqueName: \"kubernetes.io/projected/54ecc0f3-f365-4507-87dd-45746d79c442-kube-api-access-jgjbc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:55.971350 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:55.971285    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:55.971350 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:55.971316    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:55.971442 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:55.971370    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ecc0f3-f365-4507-87dd-45746d79c442-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:55.971531 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:55.971503    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:55.971611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:55.971595    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.006662 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.006623    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Oct 30 19:36:56.007913 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.007888    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"]
Oct 30 19:36:56.026672 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.026607    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:36:56.072978 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.072943    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.072978 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.072980    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.073175 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.073000    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ecc0f3-f365-4507-87dd-45746d79c442-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.073175 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.073036    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.073175 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.073078    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.073175 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.073122    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgjbc\" (UniqueName: \"kubernetes.io/projected/54ecc0f3-f365-4507-87dd-45746d79c442-kube-api-access-jgjbc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.073509 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.073477    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.073643 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.073506    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.073643 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.073548    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.075490 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.075468    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54ecc0f3-f365-4507-87dd-45746d79c442-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.075723 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.075708    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54ecc0f3-f365-4507-87dd-45746d79c442-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.131801 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.131765    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgjbc\" (UniqueName: \"kubernetes.io/projected/54ecc0f3-f365-4507-87dd-45746d79c442-kube-api-access-jgjbc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd\" (UID: \"54ecc0f3-f365-4507-87dd-45746d79c442\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.222205 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.222108    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:56.590633 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:56.590593    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"]
Oct 30 19:36:56.593738 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:36:56.593711    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ecc0f3_f365_4507_87dd_45746d79c442.slice/crio-f0b351f01657974750cc6c0659b6754b755631fa951dd02c11948898a156a4ac WatchSource:0}: Error finding container f0b351f01657974750cc6c0659b6754b755631fa951dd02c11948898a156a4ac: Status 404 returned error can't find the container with id f0b351f01657974750cc6c0659b6754b755631fa951dd02c11948898a156a4ac
Oct 30 19:36:57.476782 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:57.476684    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd" event={"ID":"54ecc0f3-f365-4507-87dd-45746d79c442","Type":"ContainerStarted","Data":"4f0539acfbeed07d0278162b91d09b48bca82d9575a4b4ce97a0629659f81681"}
Oct 30 19:36:57.476782 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:57.476779    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd" event={"ID":"54ecc0f3-f365-4507-87dd-45746d79c442","Type":"ContainerStarted","Data":"f0b351f01657974750cc6c0659b6754b755631fa951dd02c11948898a156a4ac"}
Oct 30 19:36:57.589218 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:57.589147    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd" podStartSLOduration=1.9738626240000001 podStartE2EDuration="2.589128567s" totalImagesPullingTime="615.265943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:36:57.588046804 +0000 UTC m=+680.130854070" watchObservedRunningTime="2026-10-30 19:36:57.589128567 +0000 UTC m=+680.131935831"
Oct 30 19:36:58.215122 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:36:58.215089    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:36:58.222221 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:58.222200    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:36:59.583438 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:59.583410    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:36:59.593699 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:36:59.593674    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:37:00.501585 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.501557    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-7q7rc"
Oct 30 19:37:00.528955 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.528911    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6zjkp"]
Oct 30 19:37:00.532476 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.532451    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.586830 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.586781    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Oct 30 19:37:00.603581 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.603547    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6zjkp"]
Oct 30 19:37:00.623575 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.623545    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.623750 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.623590    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-home\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.623750 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.623609    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.623750 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.623661    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8lp7\" (UniqueName: \"kubernetes.io/projected/b1c0347b-370b-4d32-b4c4-480b87849789-kube-api-access-j8lp7\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.623904 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.623847    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.623904 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.623872    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c0347b-370b-4d32-b4c4-480b87849789-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.675198 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.675160    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:37:00.725139 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.725101    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.725139 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.725138    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-home\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.725343 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.725153    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.725343 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.725273    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8lp7\" (UniqueName: \"kubernetes.io/projected/b1c0347b-370b-4d32-b4c4-480b87849789-kube-api-access-j8lp7\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.725460 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.725442    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.725514 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.725474    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c0347b-370b-4d32-b4c4-480b87849789-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.725568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.725476    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-home\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.725568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.725542    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.725676 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.725656    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.727575 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.727551    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c0347b-370b-4d32-b4c4-480b87849789-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.727883 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.727866    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c0347b-370b-4d32-b4c4-480b87849789-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.783905 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.783827    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8lp7\" (UniqueName: \"kubernetes.io/projected/b1c0347b-370b-4d32-b4c4-480b87849789-kube-api-access-j8lp7\") pod \"echo-simulator-kserve-64b6f8f96c-6zjkp\" (UID: \"b1c0347b-370b-4d32-b4c4-480b87849789\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.845899 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.845860    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:00.967790 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.967757    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"]
Oct 30 19:37:00.972402 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:00.972380    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.021836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.021776    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q8znj\""
Oct 30 19:37:01.022139 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.022123    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 19:37:01.029456 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.029426    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"]
Oct 30 19:37:01.129136 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.129097    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.129330 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.129207    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.129330 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.129247    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.129330 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.129285    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pxs5\" (UniqueName: \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-kube-api-access-4pxs5\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.129510 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.129418    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.129510 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.129456    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c2f2860-b52f-4a25-ae38-2900031e33ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.129586 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.129521    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.129586 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.129577    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.129650 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.129600    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.214728 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.214697    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6zjkp"]
Oct 30 19:37:01.217178 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:37:01.217140    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c0347b_370b_4d32_b4c4_480b87849789.slice/crio-0fd2d12ed1ab5325521c010522311bea1c8ce2c11d7384042902e43273ae167f WatchSource:0}: Error finding container 0fd2d12ed1ab5325521c010522311bea1c8ce2c11d7384042902e43273ae167f: Status 404 returned error can't find the container with id 0fd2d12ed1ab5325521c010522311bea1c8ce2c11d7384042902e43273ae167f
Oct 30 19:37:01.230956 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.230915    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.230956 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.230957    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pxs5\" (UniqueName: \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-kube-api-access-4pxs5\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231156 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.230995    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231156 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.231023    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c2f2860-b52f-4a25-ae38-2900031e33ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231156 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.231069    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.231217    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.231274    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231434 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.231324    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231434 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.231371    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231434 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.231399    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231581 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.231510    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231645 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.231610    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231712 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.231692    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.231784 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.231768    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c2f2860-b52f-4a25-ae38-2900031e33ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.233721 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.233697    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.233852 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.233832    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.290042 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.290004    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pxs5\" (UniqueName: \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-kube-api-access-4pxs5\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.290522 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.290503    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-6ns9w\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:01.496987 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.496903    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp" event={"ID":"b1c0347b-370b-4d32-b4c4-480b87849789","Type":"ContainerStarted","Data":"0fd2d12ed1ab5325521c010522311bea1c8ce2c11d7384042902e43273ae167f"}
Oct 30 19:37:01.585941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:01.585910    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:02.055700 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:02.055668    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"]
Oct 30 19:37:02.060377 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:37:02.060346    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2f2860_b52f_4a25_ae38_2900031e33ed.slice/crio-eb1ffd929879ff9208b6c8d7cec656dcf5bd40d0ce1749e027887d2616d29b26 WatchSource:0}: Error finding container eb1ffd929879ff9208b6c8d7cec656dcf5bd40d0ce1749e027887d2616d29b26: Status 404 returned error can't find the container with id eb1ffd929879ff9208b6c8d7cec656dcf5bd40d0ce1749e027887d2616d29b26
Oct 30 19:37:02.062705 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:02.062685    6015 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:37:02.504642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:02.504553    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" event={"ID":"7c2f2860-b52f-4a25-ae38-2900031e33ed","Type":"ContainerStarted","Data":"eb1ffd929879ff9208b6c8d7cec656dcf5bd40d0ce1749e027887d2616d29b26"}
Oct 30 19:37:03.848104 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:03.848070    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:37:04.516678 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:04.516641    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp" event={"ID":"b1c0347b-370b-4d32-b4c4-480b87849789","Type":"ContainerStarted","Data":"909067347c64581f62c763f6a1fdff8ad105302dcf861bbf536b9973803cbd84"}
Oct 30 19:37:04.629799 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:04.629744    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp" podStartSLOduration=2.241357254 podStartE2EDuration="4.629727726s" totalImagesPullingTime="2.388370472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:37:04.628727585 +0000 UTC m=+687.171534850" watchObservedRunningTime="2026-10-30 19:37:04.629727726 +0000 UTC m=+687.172534992"
Oct 30 19:37:04.846217 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:04.846177    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:06.223207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:06.223160    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:37:06.236157 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:06.236128    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:37:06.541359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:06.541280    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd"
Oct 30 19:37:07.197257 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:07.197215    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:37:07.990958 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:07.990922    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:37:07.991265 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:07.990999    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:37:07.991265 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:07.991032    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:37:08.540652 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:08.540613    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" event={"ID":"7c2f2860-b52f-4a25-ae38-2900031e33ed","Type":"ContainerStarted","Data":"a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240"}
Oct 30 19:37:08.590027 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:08.589979    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:08.703191 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:08.703138    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podStartSLOduration=2.776302038 podStartE2EDuration="8.703123283s" totalImagesPullingTime="5.926821245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:37:08.701760687 +0000 UTC m=+691.244567952" watchObservedRunningTime="2026-10-30 19:37:08.703123283 +0000 UTC m=+691.245930548"
Oct 30 19:37:09.591825 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:09.591756    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6ns9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Oct 30 19:37:09.592324 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:09.591875    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Oct 30 19:37:10.588829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:10.588182    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6ns9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Oct 30 19:37:10.588829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:10.588243    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Oct 30 19:37:10.846497 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:10.846413    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:10.858721 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:10.858697    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:11.574158 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:11.574124    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-6zjkp"
Oct 30 19:37:11.590259 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:11.590225    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6ns9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Oct 30 19:37:11.590454 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:11.590286    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Oct 30 19:37:12.588268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:12.588229    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6ns9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Oct 30 19:37:12.588955 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:12.588911    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Oct 30 19:37:13.590363 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:13.590315    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6ns9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Oct 30 19:37:13.590784 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:13.590381    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Oct 30 19:37:14.587200 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:14.587160    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6ns9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Oct 30 19:37:14.587347 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:14.587246    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Oct 30 19:37:16.586368 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:16.586332    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:16.586897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:16.586662    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6ns9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 19:37:16.586897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:16.586737    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:37:17.630075 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:17.630026    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6ns9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 19:37:17.630829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:17.630760    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:37:17.910681 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:17.910600    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:17.911680 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:17.911651    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 19:37:28.216318 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:37:28.216280    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:37:33.635633 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:33.635576    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:37:33.841975 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:33.841938    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:37:35.263859 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:35.263794    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:37:35.417898 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:35.417866    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:37:42.475322 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:42.475274    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:37:44.797910 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:37:44.797860    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:37:58.214836 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:37:58.214769    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:38:15.093725 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:15.093694    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:15.432705 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:15.432565    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:15.595335 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:15.595299    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:15.839355 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:15.839317    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:16.010621 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.010585    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:16.031095 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.031060    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"]
Oct 30 19:38:16.033761 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.033743    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.119910 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.119790    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"]
Oct 30 19:38:16.136588 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.136557    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-87e6ae88-openshift-default-dockercfg-c9g54\""
Oct 30 19:38:16.164833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.164783    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a917bdc-59d5-48aa-bd97-082055b0d932-istiod-ca-cert\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.165040 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.164847    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-credential-socket\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.165040 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.164943    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-envoy\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.165040 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.164992    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-data\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.165190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.165055    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-certs\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.165190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.165085    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khq6k\" (UniqueName: \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-kube-api-access-khq6k\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.165190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.165104    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-podinfo\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.165190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.165132    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-socket\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.165333 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.165269    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-token\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.174233 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.174207    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:16.266516 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.266479    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-envoy\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.266690 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.266527    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-data\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.266690 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.266662    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-certs\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.266780 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.266713    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khq6k\" (UniqueName: \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-kube-api-access-khq6k\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.266780 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.266741    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-podinfo\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.266922 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.266779    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-socket\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.266922 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.266836    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-token\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.266922 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.266911    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a917bdc-59d5-48aa-bd97-082055b0d932-istiod-ca-cert\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.267058 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.266929    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-data\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.267058 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.266946    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-credential-socket\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.267155 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.267065    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-certs\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.267543 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.267517    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-credential-socket\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.267849 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.267739    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-socket\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.267968 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.267947    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a917bdc-59d5-48aa-bd97-082055b0d932-istiod-ca-cert\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.269255 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.269235    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-envoy\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.269508 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.269491    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-podinfo\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.325782 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.325748    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-token\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.327230 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.327208    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khq6k\" (UniqueName: \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-kube-api-access-khq6k\") pod \"e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") " pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.347022 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.346971    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:16.370629 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.370541    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:16.521054 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.521019    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:16.764163 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.764077    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:16.787742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.787655    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"]
Oct 30 19:38:16.790605 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:38:16.790577    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a917bdc_59d5_48aa_bd97_082055b0d932.slice/crio-b839d8c171b29bcf913d167a10c95ba783028f81673d78737c3900801ed6f072 WatchSource:0}: Error finding container b839d8c171b29bcf913d167a10c95ba783028f81673d78737c3900801ed6f072: Status 404 returned error can't find the container with id b839d8c171b29bcf913d167a10c95ba783028f81673d78737c3900801ed6f072
Oct 30 19:38:16.792664 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.792634    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:16.792716 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.792702    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:16.792751 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.792729    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:16.864863 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.864835    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" event={"ID":"8a917bdc-59d5-48aa-bd97-082055b0d932","Type":"ContainerStarted","Data":"b839d8c171b29bcf913d167a10c95ba783028f81673d78737c3900801ed6f072"}
Oct 30 19:38:16.927083 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:16.927046    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:17.871390 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:17.871356    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" event={"ID":"8a917bdc-59d5-48aa-bd97-082055b0d932","Type":"ContainerStarted","Data":"4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a"}
Oct 30 19:38:18.348013 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.347971    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:18.353150 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.353124    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:18.470993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.470939    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" podStartSLOduration=3.470922002 podStartE2EDuration="3.470922002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:38:18.085040559 +0000 UTC m=+760.627847825" watchObservedRunningTime="2026-10-30 19:38:18.470922002 +0000 UTC m=+761.013729266"
Oct 30 19:38:18.877114 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.877085    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:18.878096 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.878076    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:18.892626 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.892594    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"]
Oct 30 19:38:18.895446 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.895427    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:18.946857 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.946820    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5442f600-openshift-default-dockercfg-smnrf\""
Oct 30 19:38:18.957576 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.957542    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"]
Oct 30 19:38:18.998942 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.998903    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-certs\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:18.999129 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.998947    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-data\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:18.999129 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.999028    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-envoy\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:18.999129 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.999095    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d322a36-2162-40e2-af60-0305d3923fb5-istio-podinfo\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:18.999303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.999242    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-credential-socket\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:18.999360 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.999301    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-istio-token\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:18.999411 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.999370    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d322a36-2162-40e2-af60-0305d3923fb5-istiod-ca-cert\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:18.999464 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.999414    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2vgj\" (UniqueName: \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-kube-api-access-l2vgj\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:18.999518 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:18.999481    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-socket\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.000491 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.000463    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:19.100556 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.100521    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-credential-socket\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.100746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.100569    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-istio-token\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.100746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.100598    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d322a36-2162-40e2-af60-0305d3923fb5-istiod-ca-cert\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.100746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.100621    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vgj\" (UniqueName: \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-kube-api-access-l2vgj\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.100746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.100650    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-socket\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.100746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.100684    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-certs\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.100746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.100703    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-data\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.100746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.100745    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-envoy\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.101220 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.100772    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d322a36-2162-40e2-af60-0305d3923fb5-istio-podinfo\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.101220 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.101065    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-credential-socket\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.101220 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.101090    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-data\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.101220 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.101199    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-certs\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.101436 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.101244    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-socket\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.101656 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.101633    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d322a36-2162-40e2-af60-0305d3923fb5-istiod-ca-cert\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.103252 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.103227    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-envoy\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.103460 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.103444    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d322a36-2162-40e2-af60-0305d3923fb5-istio-podinfo\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.172939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.172861    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-istio-token\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.173094 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.173056    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2vgj\" (UniqueName: \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-kube-api-access-l2vgj\") pod \"e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") " pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.182767 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.182732    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:19.207854 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.207814    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:19.509542 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.509439    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:19.628368 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.628341    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"]
Oct 30 19:38:19.631066 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:38:19.631036    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d322a36_2162_40e2_af60_0305d3923fb5.slice/crio-4e31fa60a4015c8912239f5dff7b916b3559fcb095e98c11118f51d0ae4b0a7e WatchSource:0}: Error finding container 4e31fa60a4015c8912239f5dff7b916b3559fcb095e98c11118f51d0ae4b0a7e: Status 404 returned error can't find the container with id 4e31fa60a4015c8912239f5dff7b916b3559fcb095e98c11118f51d0ae4b0a7e
Oct 30 19:38:19.633407 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.633376    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:19.633486 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.633446    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:19.633572 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.633484    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:19.884595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.884558    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" event={"ID":"0d322a36-2162-40e2-af60-0305d3923fb5","Type":"ContainerStarted","Data":"7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79"}
Oct 30 19:38:19.885177 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:19.884611    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" event={"ID":"0d322a36-2162-40e2-af60-0305d3923fb5","Type":"ContainerStarted","Data":"4e31fa60a4015c8912239f5dff7b916b3559fcb095e98c11118f51d0ae4b0a7e"}
Oct 30 19:38:20.001588 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:20.001504    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" podStartSLOduration=2.001485235 podStartE2EDuration="2.001485235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:38:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:38:20.000204269 +0000 UTC m=+762.543011535" watchObservedRunningTime="2026-10-30 19:38:20.001485235 +0000 UTC m=+762.544292500"
Oct 30 19:38:20.088324 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:20.088285    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:20.208510 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:20.208414    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:20.213890 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:20.213863    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:20.309906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:20.309865    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:20.889662 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:20.889621    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:20.890610 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:20.890595    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:22.304344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:22.304300    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:22.499276 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:22.499238    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:22.672461 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:22.672368    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:22.842025 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:22.841994    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:22.886961 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:22.886922    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"]
Oct 30 19:38:22.890176 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:22.890151    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:38:22.947755 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:22.947672    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whs7t\" (UniqueName: \"kubernetes.io/projected/85fd040f-5d0a-4b00-9eab-06056c925fd7-kube-api-access-whs7t\") pod \"payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t\" (UID: \"85fd040f-5d0a-4b00-9eab-06056c925fd7\") " pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:38:22.947940 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:22.947789    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85fd040f-5d0a-4b00-9eab-06056c925fd7-plugins-config-volume\") pod \"payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t\" (UID: \"85fd040f-5d0a-4b00-9eab-06056c925fd7\") " pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:38:22.989936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:22.989895    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-3df7da3e-dockercfg-qsb89\""
Oct 30 19:38:22.989936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:22.989925    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-3df7da3e\""
Oct 30 19:38:22.991377 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:22.991355    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"]
Oct 30 19:38:23.048555 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:23.048517    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whs7t\" (UniqueName: \"kubernetes.io/projected/85fd040f-5d0a-4b00-9eab-06056c925fd7-kube-api-access-whs7t\") pod \"payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t\" (UID: \"85fd040f-5d0a-4b00-9eab-06056c925fd7\") " pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:38:23.048720 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:23.048567    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85fd040f-5d0a-4b00-9eab-06056c925fd7-plugins-config-volume\") pod \"payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t\" (UID: \"85fd040f-5d0a-4b00-9eab-06056c925fd7\") " pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:38:23.049495 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:23.049474    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85fd040f-5d0a-4b00-9eab-06056c925fd7-plugins-config-volume\") pod \"payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t\" (UID: \"85fd040f-5d0a-4b00-9eab-06056c925fd7\") " pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:38:23.111964 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:23.111931    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whs7t\" (UniqueName: \"kubernetes.io/projected/85fd040f-5d0a-4b00-9eab-06056c925fd7-kube-api-access-whs7t\") pod \"payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t\" (UID: \"85fd040f-5d0a-4b00-9eab-06056c925fd7\") " pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:38:23.206029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:23.205940    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:38:23.389206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:23.389170    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:23.588741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:23.588701    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"]
Oct 30 19:38:23.591208 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:38:23.591182    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fd040f_5d0a_4b00_9eab_06056c925fd7.slice/crio-8e2ba6a7e540903eeb3c4efd550e9536de8b7bc20ebc2bce424d2fe10eed85fa WatchSource:0}: Error finding container 8e2ba6a7e540903eeb3c4efd550e9536de8b7bc20ebc2bce424d2fe10eed85fa: Status 404 returned error can't find the container with id 8e2ba6a7e540903eeb3c4efd550e9536de8b7bc20ebc2bce424d2fe10eed85fa
Oct 30 19:38:23.664654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:23.664623    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:23.838472 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:23.838375    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:23.905896 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:23.905864    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t" event={"ID":"85fd040f-5d0a-4b00-9eab-06056c925fd7","Type":"ContainerStarted","Data":"8e2ba6a7e540903eeb3c4efd550e9536de8b7bc20ebc2bce424d2fe10eed85fa"}
Oct 30 19:38:24.001869 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:24.001823    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:25.052719 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.052674    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"]
Oct 30 19:38:25.056626 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.056604    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.066108 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.066083    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-metrics-certs\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.066174 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.066123    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-292zk\" (UniqueName: \"kubernetes.io/projected/6de22856-89be-44c9-b612-f2e32a21571f-kube-api-access-292zk\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.066174 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.066150    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-maas-api-tls\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.066270 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.066254    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de22856-89be-44c9-b612-f2e32a21571f-openshift-service-ca\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.108086 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.108055    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-87e6ae88-serving-cert\""
Oct 30 19:38:25.155887 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.155841    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"]
Oct 30 19:38:25.167357 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.167323    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de22856-89be-44c9-b612-f2e32a21571f-openshift-service-ca\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.167579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.167380    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-metrics-certs\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.167579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.167408    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-292zk\" (UniqueName: \"kubernetes.io/projected/6de22856-89be-44c9-b612-f2e32a21571f-kube-api-access-292zk\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.167579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.167430    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-maas-api-tls\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.167745 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:38:25.167642    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-serving-cert: secret "maas-api-e2e-ait-87e6ae88-serving-cert" not found
Oct 30 19:38:25.167745 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:38:25.167732    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-maas-api-tls podName:6de22856-89be-44c9-b612-f2e32a21571f nodeName:}" failed. No retries permitted until 2026-10-30 19:38:25.667691414 +0000 UTC m=+768.210498671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-maas-api-tls") pod "maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm" (UID: "6de22856-89be-44c9-b612-f2e32a21571f") : secret "maas-api-e2e-ait-87e6ae88-serving-cert" not found
Oct 30 19:38:25.168060 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.168038    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de22856-89be-44c9-b612-f2e32a21571f-openshift-service-ca\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.171661 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.171634    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-metrics-certs\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.231383 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.231348    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-292zk\" (UniqueName: \"kubernetes.io/projected/6de22856-89be-44c9-b612-f2e32a21571f-kube-api-access-292zk\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.248928 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.248885    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:25.513738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.513651    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:25.673720 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.673671    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-maas-api-tls\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.677017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.676992    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-maas-api-tls\") pod \"maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:25.974222 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:25.974185    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:26.370025 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:26.369989    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"]
Oct 30 19:38:26.373675 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:38:26.373644    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de22856_89be_44c9_b612_f2e32a21571f.slice/crio-de34afcea7bf67460e6b867abaea04ed50fa443f3f5f42ee29dd2342ce43d022 WatchSource:0}: Error finding container de34afcea7bf67460e6b867abaea04ed50fa443f3f5f42ee29dd2342ce43d022: Status 404 returned error can't find the container with id de34afcea7bf67460e6b867abaea04ed50fa443f3f5f42ee29dd2342ce43d022
Oct 30 19:38:26.925063 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:26.925023    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm" event={"ID":"6de22856-89be-44c9-b612-f2e32a21571f","Type":"ContainerStarted","Data":"de34afcea7bf67460e6b867abaea04ed50fa443f3f5f42ee29dd2342ce43d022"}
Oct 30 19:38:26.926559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:26.926532    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t" event={"ID":"85fd040f-5d0a-4b00-9eab-06056c925fd7","Type":"ContainerStarted","Data":"97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e"}
Oct 30 19:38:26.926692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:26.926585    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:38:27.039914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:27.039864    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t" podStartSLOduration=2.277663957 podStartE2EDuration="5.039842042s" totalImagesPullingTime="2.762178085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:38:27.037879236 +0000 UTC m=+769.580686502" watchObservedRunningTime="2026-10-30 19:38:27.039842042 +0000 UTC m=+769.582649309"
Oct 30 19:38:27.347775 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:27.347739    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:27.583392 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:27.583360    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:27.932707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:27.932601    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm" event={"ID":"6de22856-89be-44c9-b612-f2e32a21571f","Type":"ContainerStarted","Data":"241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4"}
Oct 30 19:38:27.932896 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:27.932784    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:28.046321 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:28.046253    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm" podStartSLOduration=2.8975080330000003 podStartE2EDuration="4.046231493s" totalImagesPullingTime="1.14872346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:38:28.045139525 +0000 UTC m=+770.587946811" watchObservedRunningTime="2026-10-30 19:38:28.046231493 +0000 UTC m=+770.589038759"
Oct 30 19:38:28.216087 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:38:28.216000    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:38:29.898676 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:29.898637    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:30.081880 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.081849    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"]
Oct 30 19:38:30.088981 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.088946    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.094501 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.094470    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:30.122744 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.122707    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbngz\" (UniqueName: \"kubernetes.io/projected/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-kube-api-access-fbngz\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.122744 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.122748    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-maas-api-tls\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.122998 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.122768    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-metrics-certs\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.123035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.122991    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-openshift-service-ca\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.144191 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.144155    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5442f600-serving-cert\""
Oct 30 19:38:30.189398 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.189303    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"]
Oct 30 19:38:30.224607 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.224571    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-openshift-service-ca\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.224829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.224638    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbngz\" (UniqueName: \"kubernetes.io/projected/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-kube-api-access-fbngz\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.224829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.224673    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-maas-api-tls\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.224829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.224696    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-metrics-certs\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.224999 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:38:30.224833    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-serving-cert: secret "maas-api-e2e-ait-5442f600-serving-cert" not found
Oct 30 19:38:30.224999 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:38:30.224902    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-maas-api-tls podName:dc87d9fe-f45a-4dac-b12b-5e7a764486d4 nodeName:}" failed. No retries permitted until 2026-10-30 19:38:30.724879528 +0000 UTC m=+773.267686786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-maas-api-tls") pod "maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc" (UID: "dc87d9fe-f45a-4dac-b12b-5e7a764486d4") : secret "maas-api-e2e-ait-5442f600-serving-cert" not found
Oct 30 19:38:30.225431 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.225412    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-openshift-service-ca\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.227466 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.227444    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-metrics-certs\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.294148 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.294109    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbngz\" (UniqueName: \"kubernetes.io/projected/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-kube-api-access-fbngz\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.624046 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.624001    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:30.729864 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.729825    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-maas-api-tls\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.732527 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.732500    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-maas-api-tls\") pod \"maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:30.809891 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:30.809854    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:31.003978 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:31.003871    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:31.394217 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:31.394190    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"]
Oct 30 19:38:31.396881 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:38:31.396846    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc87d9fe_f45a_4dac_b12b_5e7a764486d4.slice/crio-815cccf38e33cfc5e20e5414d2262cd473794e6959ec0aa065c46e58ad5db445 WatchSource:0}: Error finding container 815cccf38e33cfc5e20e5414d2262cd473794e6959ec0aa065c46e58ad5db445: Status 404 returned error can't find the container with id 815cccf38e33cfc5e20e5414d2262cd473794e6959ec0aa065c46e58ad5db445
Oct 30 19:38:31.955020 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:31.954985    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc" event={"ID":"dc87d9fe-f45a-4dac-b12b-5e7a764486d4","Type":"ContainerStarted","Data":"815cccf38e33cfc5e20e5414d2262cd473794e6959ec0aa065c46e58ad5db445"}
Oct 30 19:38:32.741616 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:32.741584    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:32.951311 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:32.951280    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:32.961889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:32.961859    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc" event={"ID":"dc87d9fe-f45a-4dac-b12b-5e7a764486d4","Type":"ContainerStarted","Data":"a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073"}
Oct 30 19:38:32.962083 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:32.962015    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:33.075112 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:33.075062    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc" podStartSLOduration=2.279222152 podStartE2EDuration="3.075048264s" totalImagesPullingTime="795.826112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:38:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:38:33.073478163 +0000 UTC m=+775.616285432" watchObservedRunningTime="2026-10-30 19:38:33.075048264 +0000 UTC m=+775.617855528"
Oct 30 19:38:33.943471 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:33.943440    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:38:35.412561 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.412523    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"]
Oct 30 19:38:35.416619 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.416595    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.470491 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.470455    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3df7da3e-serving-cert\""
Oct 30 19:38:35.477703 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.477672    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmbwk\" (UniqueName: \"kubernetes.io/projected/58c742f5-a7f4-4ab3-a445-8477965fe62a-kube-api-access-vmbwk\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.477889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.477726    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-metrics-certs\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.477889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.477863    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-maas-api-tls\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.477975 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.477959    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c742f5-a7f4-4ab3-a445-8477965fe62a-openshift-service-ca\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.518577 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.518542    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"]
Oct 30 19:38:35.578700 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.578666    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-maas-api-tls\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.578896 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.578770    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c742f5-a7f4-4ab3-a445-8477965fe62a-openshift-service-ca\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.578896 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:38:35.578820    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-serving-cert: secret "maas-api-e2e-ait-3df7da3e-serving-cert" not found
Oct 30 19:38:35.578896 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:38:35.578884    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-maas-api-tls podName:58c742f5-a7f4-4ab3-a445-8477965fe62a nodeName:}" failed. No retries permitted until 2026-10-30 19:38:36.078867963 +0000 UTC m=+778.621675219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-maas-api-tls") pod "maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg" (UID: "58c742f5-a7f4-4ab3-a445-8477965fe62a") : secret "maas-api-e2e-ait-3df7da3e-serving-cert" not found
Oct 30 19:38:35.579070 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.578910    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmbwk\" (UniqueName: \"kubernetes.io/projected/58c742f5-a7f4-4ab3-a445-8477965fe62a-kube-api-access-vmbwk\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.579070 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.578941    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-metrics-certs\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.579705 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.579641    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c742f5-a7f4-4ab3-a445-8477965fe62a-openshift-service-ca\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.581667 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.581634    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-metrics-certs\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.598198 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.598165    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:35.637612 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.637575    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmbwk\" (UniqueName: \"kubernetes.io/projected/58c742f5-a7f4-4ab3-a445-8477965fe62a-kube-api-access-vmbwk\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:35.796063 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.796031    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:35.953200 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:35.953151    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:36.085150 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:36.085055    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-maas-api-tls\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:36.087666 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:36.087647    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-maas-api-tls\") pod \"maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:36.330084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:36.330036    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:36.702304 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:36.702219    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"]
Oct 30 19:38:36.705417 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:38:36.705373    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c742f5_a7f4_4ab3_a445_8477965fe62a.slice/crio-cfd4570bb56457c7015130a1147d5cf20688c99217ee0db98856848b2356857b WatchSource:0}: Error finding container cfd4570bb56457c7015130a1147d5cf20688c99217ee0db98856848b2356857b: Status 404 returned error can't find the container with id cfd4570bb56457c7015130a1147d5cf20688c99217ee0db98856848b2356857b
Oct 30 19:38:36.983682 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:36.983596    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg" event={"ID":"58c742f5-a7f4-4ab3-a445-8477965fe62a","Type":"ContainerStarted","Data":"cfd4570bb56457c7015130a1147d5cf20688c99217ee0db98856848b2356857b"}
Oct 30 19:38:37.935862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:37.935749    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:38:37.991662 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:37.991625    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg" event={"ID":"58c742f5-a7f4-4ab3-a445-8477965fe62a","Type":"ContainerStarted","Data":"602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856"}
Oct 30 19:38:37.991918 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:37.991706    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:38.162270 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:38.162200    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg" podStartSLOduration=2.290880618 podStartE2EDuration="3.162182999s" totalImagesPullingTime="871.302381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:38:38.161642966 +0000 UTC m=+780.704450232" watchObservedRunningTime="2026-10-30 19:38:38.162182999 +0000 UTC m=+780.704990255"
Oct 30 19:38:38.985831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:38.977515    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:38:40.392016 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:40.391964    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:42.429420 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:42.429360    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:42.643666 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:42.643609    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:42.824217 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:42.824179    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:44.020831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:44.020332    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:38:45.005862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:45.005757    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:45.168665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:45.168625    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:45.339534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:45.339497    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:48.879047 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:48.878999    6015 patch_prober.go:29] interesting pod/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 30 19:38:48.879625 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:48.879056    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 30 19:38:49.077753 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.077717    6015 generic.go:356] "Generic (PLEG): container finished" podID="0d322a36-2162-40e2-af60-0305d3923fb5" containerID="7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79" exitCode=0
Oct 30 19:38:49.077963 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.077791    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" event={"ID":"0d322a36-2162-40e2-af60-0305d3923fb5","Type":"ContainerDied","Data":"7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79"}
Oct 30 19:38:49.078249 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.078233    6015 scope.go:122] "RemoveContainer" containerID="7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79"
Oct 30 19:38:49.079742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.079710    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:49.079906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.079792    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:49.079906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.079858    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:49.079906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.079875    6015 generic.go:356] "Generic (PLEG): container finished" podID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerID="4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a" exitCode=0
Oct 30 19:38:49.080076 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.079907    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" event={"ID":"8a917bdc-59d5-48aa-bd97-082055b0d932","Type":"ContainerDied","Data":"4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a"}
Oct 30 19:38:49.080299 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.080281    6015 scope.go:122] "RemoveContainer" containerID="4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a"
Oct 30 19:38:49.081635 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.081602    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:49.081727 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.081684    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:49.081780 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.081728    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:38:49.232207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.232160    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"]
Oct 30 19:38:49.235308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.235285    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.285832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.285200    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-be15b010-serving-cert\""
Oct 30 19:38:49.300478 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.300438    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"]
Oct 30 19:38:49.370149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.370108    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-maas-api-tls\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.370583 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.370558    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06140817-652d-4733-bdba-645a70710dfc-openshift-service-ca\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.370887 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.370868    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-metrics-certs\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.371184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.371129    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdxwk\" (UniqueName: \"kubernetes.io/projected/06140817-652d-4733-bdba-645a70710dfc-kube-api-access-tdxwk\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.426707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.426623    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:49.472956 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.472920    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-metrics-certs\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.473121 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.473009    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdxwk\" (UniqueName: \"kubernetes.io/projected/06140817-652d-4733-bdba-645a70710dfc-kube-api-access-tdxwk\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.473121 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.473047    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-maas-api-tls\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.473121 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.473086    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06140817-652d-4733-bdba-645a70710dfc-openshift-service-ca\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.473400 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:38:49.473371    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-serving-cert: secret "maas-api-e2e-derive-be15b010-serving-cert" not found
Oct 30 19:38:49.473553 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:38:49.473444    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-maas-api-tls podName:06140817-652d-4733-bdba-645a70710dfc nodeName:}" failed. No retries permitted until 2026-10-30 19:38:49.973423747 +0000 UTC m=+792.516231003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-maas-api-tls") pod "maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh" (UID: "06140817-652d-4733-bdba-645a70710dfc") : secret "maas-api-e2e-derive-be15b010-serving-cert" not found
Oct 30 19:38:49.473860 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.473839    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06140817-652d-4733-bdba-645a70710dfc-openshift-service-ca\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.483380 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.476505    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-metrics-certs\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.532375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.532338    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdxwk\" (UniqueName: \"kubernetes.io/projected/06140817-652d-4733-bdba-645a70710dfc-kube-api-access-tdxwk\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:49.589832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.589378    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:49.748055 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.747974    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:49.988831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:49.988308    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-maas-api-tls\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:50.015894 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.012611    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-maas-api-tls\") pod \"maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:50.113837 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.111220    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" event={"ID":"8a917bdc-59d5-48aa-bd97-082055b0d932","Type":"ContainerStarted","Data":"86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04"}
Oct 30 19:38:50.119835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.119614    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" event={"ID":"0d322a36-2162-40e2-af60-0305d3923fb5","Type":"ContainerStarted","Data":"881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775"}
Oct 30 19:38:50.152658 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.152620    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:50.221849 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.221318    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:50.222618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.222586    6015 patch_prober.go:29] interesting pod/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 19:38:50.222766 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.222649    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 19:38:50.349009 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.348979    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:50.349410 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.349377    6015 patch_prober.go:29] interesting pod/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 30 19:38:50.349523 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.349439    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 30 19:38:50.617057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.609930    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"]
Oct 30 19:38:50.895897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:50.892938    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:51.126156 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:51.126124    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh" event={"ID":"06140817-652d-4733-bdba-645a70710dfc","Type":"ContainerStarted","Data":"ca68aee8f10ea0451417f0fd06f1bc3831c97ce20d411fec75a5af73f6b2d64a"}
Oct 30 19:38:51.208891 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:51.208285    6015 patch_prober.go:29] interesting pod/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 19:38:51.208891 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:51.208355    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 19:38:51.348094 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:51.348062    6015 patch_prober.go:29] interesting pod/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 30 19:38:51.348326 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:51.348305    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 30 19:38:52.134056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:52.133791    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh" event={"ID":"06140817-652d-4733-bdba-645a70710dfc","Type":"ContainerStarted","Data":"a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3"}
Oct 30 19:38:52.134463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:52.134081    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:52.212721 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:52.212254    6015 patch_prober.go:29] interesting pod/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 19:38:52.212721 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:52.212319    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 19:38:52.251548 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:52.251490    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh" podStartSLOduration=2.327874382 podStartE2EDuration="3.251468672s" totalImagesPullingTime="923.59429ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:38:52.250094803 +0000 UTC m=+794.792902069" watchObservedRunningTime="2026-10-30 19:38:52.251468672 +0000 UTC m=+794.794275964"
Oct 30 19:38:52.348499 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:52.348020    6015 patch_prober.go:29] interesting pod/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 30 19:38:52.348499 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:52.348083    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 30 19:38:53.209834 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:53.209187    6015 patch_prober.go:29] interesting pod/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 19:38:53.209834 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:53.209252    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 19:38:53.348217 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:53.348175    6015 patch_prober.go:29] interesting pod/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 30 19:38:53.348405 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:53.348238    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 30 19:38:54.211833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:54.211219    6015 patch_prober.go:29] interesting pod/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 19:38:54.211833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:54.211285    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 19:38:54.280833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:54.280343    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:38:54.347384 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:54.347350    6015 patch_prober.go:29] interesting pod/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 30 19:38:54.347554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:54.347405    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 30 19:38:55.210258 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:55.210222    6015 patch_prober.go:29] interesting pod/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Oct 30 19:38:55.210479 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:55.210294    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Oct 30 19:38:55.348292 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:55.348253    6015 patch_prober.go:29] interesting pod/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Oct 30 19:38:55.348775 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:55.348316    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Oct 30 19:38:56.212956 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:56.212916    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:56.214070 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:56.214045    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:38:56.352366 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:56.352333    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:56.352748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:56.352620    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:56.353460 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:56.353446    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:38:58.144519 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:58.144489    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:38:58.219384 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:38:58.219345    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:38:58.880976 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:38:58.880936    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:03.979982 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:03.979939    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:08.912431 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:08.912393    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:12.763889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:12.763854    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:12.929890 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:12.929850    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:13.963148 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:13.963086    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:18.587772 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:18.587675    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:20.687186 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:20.687141    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:20.843186 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:20.843154    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:22.779864 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:22.779822    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"]
Oct 30 19:39:22.780307 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:22.780042    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm" podUID="6de22856-89be-44c9-b612-f2e32a21571f" containerName="maas-api" containerID="cri-o://241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4" gracePeriod=30
Oct 30 19:39:22.872717 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:22.872684    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"]
Oct 30 19:39:22.884393 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:22.884355    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:23.043366 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.043338    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:39:23.086397 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.086360    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6de22856-89be-44c9-b612-f2e32a21571f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de22856-89be-44c9-b612-f2e32a21571f-openshift-service-ca\") pod \"6de22856-89be-44c9-b612-f2e32a21571f\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") "
Oct 30 19:39:23.086565 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.086507    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-maas-api-tls\") pod \"6de22856-89be-44c9-b612-f2e32a21571f\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") "
Oct 30 19:39:23.086628 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.086613    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6de22856-89be-44c9-b612-f2e32a21571f-kube-api-access-292zk\" (UniqueName: \"kubernetes.io/projected/6de22856-89be-44c9-b612-f2e32a21571f-kube-api-access-292zk\") pod \"6de22856-89be-44c9-b612-f2e32a21571f\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") "
Oct 30 19:39:23.086683 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.086652    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-metrics-certs\") pod \"6de22856-89be-44c9-b612-f2e32a21571f\" (UID: \"6de22856-89be-44c9-b612-f2e32a21571f\") "
Oct 30 19:39:23.086837 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.086788    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6de22856-89be-44c9-b612-f2e32a21571f-openshift-service-ca" pod "6de22856-89be-44c9-b612-f2e32a21571f" (UID: "6de22856-89be-44c9-b612-f2e32a21571f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:39:23.087012 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.086995    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de22856-89be-44c9-b612-f2e32a21571f-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:23.089003 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.088971    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-maas-api-tls" pod "6de22856-89be-44c9-b612-f2e32a21571f" (UID: "6de22856-89be-44c9-b612-f2e32a21571f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:39:23.089091 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.088974    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de22856-89be-44c9-b612-f2e32a21571f-kube-api-access-292zk" pod "6de22856-89be-44c9-b612-f2e32a21571f" (UID: "6de22856-89be-44c9-b612-f2e32a21571f"). InnerVolumeSpecName "kube-api-access-292zk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:39:23.089091 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.089016    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-metrics-certs" pod "6de22856-89be-44c9-b612-f2e32a21571f" (UID: "6de22856-89be-44c9-b612-f2e32a21571f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:39:23.187611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.187578    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:23.187611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.187607    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-292zk\" (UniqueName: \"kubernetes.io/projected/6de22856-89be-44c9-b612-f2e32a21571f-kube-api-access-292zk\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:23.187611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.187619    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de22856-89be-44c9-b612-f2e32a21571f-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:23.234938 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.234896    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:23.311986 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.311891    6015 generic.go:356] "Generic (PLEG): container finished" podID="6de22856-89be-44c9-b612-f2e32a21571f" containerID="241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4" exitCode=0
Oct 30 19:39:23.311986 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.311938    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"
Oct 30 19:39:23.312186 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.311973    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm" event={"ID":"6de22856-89be-44c9-b612-f2e32a21571f","Type":"ContainerDied","Data":"241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4"}
Oct 30 19:39:23.312186 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.312037    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm" event={"ID":"6de22856-89be-44c9-b612-f2e32a21571f","Type":"ContainerDied","Data":"de34afcea7bf67460e6b867abaea04ed50fa443f3f5f42ee29dd2342ce43d022"}
Oct 30 19:39:23.312186 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.312059    6015 scope.go:122] "RemoveContainer" containerID="241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4"
Oct 30 19:39:23.322039 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.322016    6015 scope.go:122] "RemoveContainer" containerID="241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4"
Oct 30 19:39:23.322330 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:23.322306    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4\": container with ID starting with 241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4 not found: ID does not exist" containerID="241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4"
Oct 30 19:39:23.322379 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.322341    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4"} err="failed to get container status \"241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4\": rpc error: code = NotFound desc = could not find container \"241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4\": container with ID starting with 241317a7d0b4cc42fd55be4f5606911ddb25e68d0dac704530acccca6a25eeb4 not found: ID does not exist"
Oct 30 19:39:23.389842 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.389780    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:23.470763 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.470727    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"]
Oct 30 19:39:23.474980 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.474948    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87e6ae88-797dc49c5d-rcspm"]
Oct 30 19:39:23.584828 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.584716    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6de22856-89be-44c9-b612-f2e32a21571f" path="/var/lib/kubelet/pods/6de22856-89be-44c9-b612-f2e32a21571f/volumes"
Oct 30 19:39:23.928735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.928646    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"]
Oct 30 19:39:23.929234 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.928866    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc" podUID="dc87d9fe-f45a-4dac-b12b-5e7a764486d4" containerName="maas-api" containerID="cri-o://a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073" gracePeriod=30
Oct 30 19:39:23.967467 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:23.967424    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc" podUID="dc87d9fe-f45a-4dac-b12b-5e7a764486d4" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.37:8443/health\": dial tcp 10.134.0.37:8443: connect: connection refused"
Oct 30 19:39:24.037041 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.037004    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:24.191051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.190982    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:39:24.297743 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.297709    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-maas-api-tls\") pod \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") "
Oct 30 19:39:24.297743 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.297749    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-openshift-service-ca\") pod \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") "
Oct 30 19:39:24.297958 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.297891    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-metrics-certs\") pod \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") "
Oct 30 19:39:24.297958 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.297948    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-kube-api-access-fbngz\" (UniqueName: \"kubernetes.io/projected/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-kube-api-access-fbngz\") pod \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\" (UID: \"dc87d9fe-f45a-4dac-b12b-5e7a764486d4\") "
Oct 30 19:39:24.298219 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.298191    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-openshift-service-ca" pod "dc87d9fe-f45a-4dac-b12b-5e7a764486d4" (UID: "dc87d9fe-f45a-4dac-b12b-5e7a764486d4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:39:24.300241 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.300218    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-metrics-certs" pod "dc87d9fe-f45a-4dac-b12b-5e7a764486d4" (UID: "dc87d9fe-f45a-4dac-b12b-5e7a764486d4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:39:24.300241 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.300233    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-maas-api-tls" pod "dc87d9fe-f45a-4dac-b12b-5e7a764486d4" (UID: "dc87d9fe-f45a-4dac-b12b-5e7a764486d4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:39:24.300366 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.300218    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-kube-api-access-fbngz" pod "dc87d9fe-f45a-4dac-b12b-5e7a764486d4" (UID: "dc87d9fe-f45a-4dac-b12b-5e7a764486d4"). InnerVolumeSpecName "kube-api-access-fbngz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:39:24.318759 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.318726    6015 generic.go:356] "Generic (PLEG): container finished" podID="dc87d9fe-f45a-4dac-b12b-5e7a764486d4" containerID="a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073" exitCode=0
Oct 30 19:39:24.318925 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.318785    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"
Oct 30 19:39:24.318925 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.318821    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc" event={"ID":"dc87d9fe-f45a-4dac-b12b-5e7a764486d4","Type":"ContainerDied","Data":"a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073"}
Oct 30 19:39:24.318925 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.318884    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc" event={"ID":"dc87d9fe-f45a-4dac-b12b-5e7a764486d4","Type":"ContainerDied","Data":"815cccf38e33cfc5e20e5414d2262cd473794e6959ec0aa065c46e58ad5db445"}
Oct 30 19:39:24.318925 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.318911    6015 scope.go:122] "RemoveContainer" containerID="a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073"
Oct 30 19:39:24.330305 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.330266    6015 scope.go:122] "RemoveContainer" containerID="a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073"
Oct 30 19:39:24.330742 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:24.330684    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073\": container with ID starting with a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073 not found: ID does not exist" containerID="a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073"
Oct 30 19:39:24.330881 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.330758    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073"} err="failed to get container status \"a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073\": rpc error: code = NotFound desc = could not find container \"a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073\": container with ID starting with a3f82abca454d2aaf83f3aaea287276ba505b0afeaf4f79a1738df6435f62073 not found: ID does not exist"
Oct 30 19:39:24.399727 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.399686    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:24.399727 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.399719    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbngz\" (UniqueName: \"kubernetes.io/projected/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-kube-api-access-fbngz\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:24.399727 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.399729    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:24.399727 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.399738    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc87d9fe-f45a-4dac-b12b-5e7a764486d4-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:24.420384 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.420347    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:24.476839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.476747    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"]
Oct 30 19:39:24.481043 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.481005    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5442f600-7fc5bbd989-4gkhc"]
Oct 30 19:39:24.712731 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:24.712701    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:25.052476 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.052440    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"]
Oct 30 19:39:25.052916 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.052645    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg" podUID="58c742f5-a7f4-4ab3-a445-8477965fe62a" containerName="maas-api" containerID="cri-o://602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856" gracePeriod=30
Oct 30 19:39:25.159798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.159768    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:25.313946 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.313880    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:39:25.327735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.327706    6015 generic.go:356] "Generic (PLEG): container finished" podID="58c742f5-a7f4-4ab3-a445-8477965fe62a" containerID="602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856" exitCode=0
Oct 30 19:39:25.327939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.327746    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"
Oct 30 19:39:25.327939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.327794    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg" event={"ID":"58c742f5-a7f4-4ab3-a445-8477965fe62a","Type":"ContainerDied","Data":"602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856"}
Oct 30 19:39:25.327939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.327875    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg" event={"ID":"58c742f5-a7f4-4ab3-a445-8477965fe62a","Type":"ContainerDied","Data":"cfd4570bb56457c7015130a1147d5cf20688c99217ee0db98856848b2356857b"}
Oct 30 19:39:25.327939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.327904    6015 scope.go:122] "RemoveContainer" containerID="602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856"
Oct 30 19:39:25.336598 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.336579    6015 scope.go:122] "RemoveContainer" containerID="602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856"
Oct 30 19:39:25.336917 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:25.336896    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856\": container with ID starting with 602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856 not found: ID does not exist" containerID="602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856"
Oct 30 19:39:25.336972 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.336931    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856"} err="failed to get container status \"602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856\": rpc error: code = NotFound desc = could not find container \"602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856\": container with ID starting with 602c2515dde970882e105dbb49e39294536b1a75e9d024228e7bce985b48b856 not found: ID does not exist"
Oct 30 19:39:25.410846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.409764    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-maas-api-tls\") pod \"58c742f5-a7f4-4ab3-a445-8477965fe62a\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") "
Oct 30 19:39:25.410846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.410256    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58c742f5-a7f4-4ab3-a445-8477965fe62a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c742f5-a7f4-4ab3-a445-8477965fe62a-openshift-service-ca\") pod \"58c742f5-a7f4-4ab3-a445-8477965fe62a\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") "
Oct 30 19:39:25.410846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.410393    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-metrics-certs\") pod \"58c742f5-a7f4-4ab3-a445-8477965fe62a\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") "
Oct 30 19:39:25.410846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.410471    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58c742f5-a7f4-4ab3-a445-8477965fe62a-kube-api-access-vmbwk\" (UniqueName: \"kubernetes.io/projected/58c742f5-a7f4-4ab3-a445-8477965fe62a-kube-api-access-vmbwk\") pod \"58c742f5-a7f4-4ab3-a445-8477965fe62a\" (UID: \"58c742f5-a7f4-4ab3-a445-8477965fe62a\") "
Oct 30 19:39:25.410846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.410627    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58c742f5-a7f4-4ab3-a445-8477965fe62a-openshift-service-ca" pod "58c742f5-a7f4-4ab3-a445-8477965fe62a" (UID: "58c742f5-a7f4-4ab3-a445-8477965fe62a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:39:25.411426 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.411138    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c742f5-a7f4-4ab3-a445-8477965fe62a-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:25.414831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.413012    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-maas-api-tls" pod "58c742f5-a7f4-4ab3-a445-8477965fe62a" (UID: "58c742f5-a7f4-4ab3-a445-8477965fe62a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:39:25.414831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.413240    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-metrics-certs" pod "58c742f5-a7f4-4ab3-a445-8477965fe62a" (UID: "58c742f5-a7f4-4ab3-a445-8477965fe62a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:39:25.414831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.413562    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58c742f5-a7f4-4ab3-a445-8477965fe62a-kube-api-access-vmbwk" pod "58c742f5-a7f4-4ab3-a445-8477965fe62a" (UID: "58c742f5-a7f4-4ab3-a445-8477965fe62a"). InnerVolumeSpecName "kube-api-access-vmbwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:39:25.512635 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.512604    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:25.512635 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.512630    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58c742f5-a7f4-4ab3-a445-8477965fe62a-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:25.512635 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.512640    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmbwk\" (UniqueName: \"kubernetes.io/projected/58c742f5-a7f4-4ab3-a445-8477965fe62a-kube-api-access-vmbwk\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:25.517997 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.517964    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:25.584320 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.584237    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc87d9fe-f45a-4dac-b12b-5e7a764486d4" path="/var/lib/kubelet/pods/dc87d9fe-f45a-4dac-b12b-5e7a764486d4/volumes"
Oct 30 19:39:25.736348 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.736311    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"]
Oct 30 19:39:25.738998 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.738971    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3df7da3e-84fbc497bf-7h5hg"]
Oct 30 19:39:25.830718 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:25.830688    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:26.459934 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:26.459899    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"]
Oct 30 19:39:26.460515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:26.460125    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy" containerID="cri-o://86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04" gracePeriod=30
Oct 30 19:39:26.469097 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:26.469062    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:26.622512 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:26.622452    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"]
Oct 30 19:39:26.622801 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:26.622719    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy" containerID="cri-o://881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775" gracePeriod=30
Oct 30 19:39:26.641130 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:26.641069    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:27.087163 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:27.087119    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:27.333861 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:27.333800    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:27.489600 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:27.489504    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:27.584032 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:27.583992    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58c742f5-a7f4-4ab3-a445-8477965fe62a" path="/var/lib/kubelet/pods/58c742f5-a7f4-4ab3-a445-8477965fe62a/volumes"
Oct 30 19:39:27.873994 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:27.873927    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t" podUID="85fd040f-5d0a-4b00-9eab-06056c925fd7" containerName="payload-processing" containerID="cri-o://97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e" gracePeriod=25
Oct 30 19:39:27.929555 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:27.929524    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:27.933868 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:39:27.933851    6015 logging.go:55] [core] [Channel #35 SubChannel #36]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.35:50052", ServerName: "10.134.0.35:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.35:50052: connect: connection refused"
Oct 30 19:39:28.130152 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.130094    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:39:28.177718 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.177673    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"]
Oct 30 19:39:28.178328 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178301    6015 cpu_manager.go:414] "containerMap: removing container" podUID="85fd040f-5d0a-4b00-9eab-06056c925fd7" containerName="payload-processing"
Oct 30 19:39:28.178328 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178328    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="85fd040f-5d0a-4b00-9eab-06056c925fd7" containerName="payload-processing"
Oct 30 19:39:28.178515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178351    6015 cpu_manager.go:414] "containerMap: removing container" podUID="dc87d9fe-f45a-4dac-b12b-5e7a764486d4" containerName="maas-api"
Oct 30 19:39:28.178515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178360    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc87d9fe-f45a-4dac-b12b-5e7a764486d4" containerName="maas-api"
Oct 30 19:39:28.178515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178372    6015 cpu_manager.go:414] "containerMap: removing container" podUID="58c742f5-a7f4-4ab3-a445-8477965fe62a" containerName="maas-api"
Oct 30 19:39:28.178515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178379    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58c742f5-a7f4-4ab3-a445-8477965fe62a" containerName="maas-api"
Oct 30 19:39:28.178515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178414    6015 cpu_manager.go:414] "containerMap: removing container" podUID="6de22856-89be-44c9-b612-f2e32a21571f" containerName="maas-api"
Oct 30 19:39:28.178515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178422    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6de22856-89be-44c9-b612-f2e32a21571f" containerName="maas-api"
Oct 30 19:39:28.178793 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178521    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="6de22856-89be-44c9-b612-f2e32a21571f" containerName="maas-api"
Oct 30 19:39:28.178793 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178538    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="85fd040f-5d0a-4b00-9eab-06056c925fd7" containerName="payload-processing"
Oct 30 19:39:28.178793 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178548    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc87d9fe-f45a-4dac-b12b-5e7a764486d4" containerName="maas-api"
Oct 30 19:39:28.178793 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.178558    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="58c742f5-a7f4-4ab3-a445-8477965fe62a" containerName="maas-api"
Oct 30 19:39:28.181792 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.181771    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.218986 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:28.218955    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:39:28.232206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.232177    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-a74d15-openshift-default-dockercfg-pfbt9\""
Oct 30 19:39:28.240398 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240368    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/85fd040f-5d0a-4b00-9eab-06056c925fd7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85fd040f-5d0a-4b00-9eab-06056c925fd7-plugins-config-volume\") pod \"85fd040f-5d0a-4b00-9eab-06056c925fd7\" (UID: \"85fd040f-5d0a-4b00-9eab-06056c925fd7\") "
Oct 30 19:39:28.240595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240411    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/85fd040f-5d0a-4b00-9eab-06056c925fd7-kube-api-access-whs7t\" (UniqueName: \"kubernetes.io/projected/85fd040f-5d0a-4b00-9eab-06056c925fd7-kube-api-access-whs7t\") pod \"85fd040f-5d0a-4b00-9eab-06056c925fd7\" (UID: \"85fd040f-5d0a-4b00-9eab-06056c925fd7\") "
Oct 30 19:39:28.240595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240559    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.240595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240580    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-podinfo\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.240779 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240610    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-token\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.240779 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240691    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-data\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.240779 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240746    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgm8p\" (UniqueName: \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-kube-api-access-zgm8p\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.240933 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240777    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-certs\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.240933 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240849    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85fd040f-5d0a-4b00-9eab-06056c925fd7-plugins-config-volume" pod "85fd040f-5d0a-4b00-9eab-06056c925fd7" (UID: "85fd040f-5d0a-4b00-9eab-06056c925fd7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:39:28.240933 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240876    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-credential-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.240933 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240915    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-envoy\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.241075 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.240940    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istiod-ca-cert\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.241109 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.241080    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85fd040f-5d0a-4b00-9eab-06056c925fd7-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:28.243011 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.242988    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85fd040f-5d0a-4b00-9eab-06056c925fd7-kube-api-access-whs7t" pod "85fd040f-5d0a-4b00-9eab-06056c925fd7" (UID: "85fd040f-5d0a-4b00-9eab-06056c925fd7"). InnerVolumeSpecName "kube-api-access-whs7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:39:28.250041 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.250008    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"]
Oct 30 19:39:28.258599 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.258561    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:28.342415 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.342360    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-envoy\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.342415 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.342396    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istiod-ca-cert\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.342692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.342474    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.342692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.342499    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-podinfo\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.342692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.342540    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-token\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.342692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.342581    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-data\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.342692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.342616    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgm8p\" (UniqueName: \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-kube-api-access-zgm8p\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.342692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.342645    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-certs\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.342692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.342680    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-credential-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.343084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.342742    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whs7t\" (UniqueName: \"kubernetes.io/projected/85fd040f-5d0a-4b00-9eab-06056c925fd7-kube-api-access-whs7t\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:28.343084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.342885    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.343084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.343058    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-credential-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.343300 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.343136    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-certs\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.343300 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.343191    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-data\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.343300 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.343240    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istiod-ca-cert\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.345190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.345172    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-envoy\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.345706 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.345682    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-podinfo\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.347013 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.346990    6015 generic.go:356] "Generic (PLEG): container finished" podID="85fd040f-5d0a-4b00-9eab-06056c925fd7" containerID="97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e" exitCode=0
Oct 30 19:39:28.347127 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.347057    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"
Oct 30 19:39:28.347127 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.347075    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t" event={"ID":"85fd040f-5d0a-4b00-9eab-06056c925fd7","Type":"ContainerDied","Data":"97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e"}
Oct 30 19:39:28.347127 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.347125    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t" event={"ID":"85fd040f-5d0a-4b00-9eab-06056c925fd7","Type":"ContainerDied","Data":"8e2ba6a7e540903eeb3c4efd550e9536de8b7bc20ebc2bce424d2fe10eed85fa"}
Oct 30 19:39:28.347281 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.347146    6015 scope.go:122] "RemoveContainer" containerID="97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e"
Oct 30 19:39:28.360051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.360027    6015 scope.go:122] "RemoveContainer" containerID="97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e"
Oct 30 19:39:28.360356 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:28.360337    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e\": container with ID starting with 97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e not found: ID does not exist" containerID="97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e"
Oct 30 19:39:28.360416 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.360371    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e"} err="failed to get container status \"97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e\": rpc error: code = NotFound desc = could not find container \"97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e\": container with ID starting with 97c9332e42394ffab187f8cd9a8718790903b599f5c61214c9cd338854d2a49e not found: ID does not exist"
Oct 30 19:39:28.402379 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.402283    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgm8p\" (UniqueName: \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-kube-api-access-zgm8p\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.402541 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.402480    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-token\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.471663 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.471635    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:28.494991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.494961    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:28.523971 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.523937    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"]
Oct 30 19:39:28.531655 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.531619    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t"]
Oct 30 19:39:28.631288 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.631258    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:28.918691 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.918480    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"]
Oct 30 19:39:28.921560 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:39:28.921536    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04256a40_3e15_4ed9_be3e_ec7aa0c882e4.slice/crio-b7beb16943103ccf0ed61631ea75ab5f8e13d78803c7414a3901011980e6e052 WatchSource:0}: Error finding container b7beb16943103ccf0ed61631ea75ab5f8e13d78803c7414a3901011980e6e052: Status 404 returned error can't find the container with id b7beb16943103ccf0ed61631ea75ab5f8e13d78803c7414a3901011980e6e052
Oct 30 19:39:28.929544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.926482    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:39:28.929544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.926589    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:39:28.929544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.926630    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:39:28.933591 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:28.933566    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ait-3df7da3e-f59758d8d-7mr5t" podUID="85fd040f-5d0a-4b00-9eab-06056c925fd7" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.134.0.35:50052\" within 1s: context deadline exceeded"
Oct 30 19:39:29.353827 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:29.353770    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" event={"ID":"04256a40-3e15-4ed9-be3e-ec7aa0c882e4","Type":"ContainerStarted","Data":"6216f09f6f1cab5d21904fc02ca912482d4326f6b757e87aa13781e045549e4a"}
Oct 30 19:39:29.354027 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:29.353859    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" event={"ID":"04256a40-3e15-4ed9-be3e-ec7aa0c882e4","Type":"ContainerStarted","Data":"b7beb16943103ccf0ed61631ea75ab5f8e13d78803c7414a3901011980e6e052"}
Oct 30 19:39:29.471877 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:29.471791    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" podStartSLOduration=1.471770456 podStartE2EDuration="1.471770456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:39:29.468533167 +0000 UTC m=+832.011340427" watchObservedRunningTime="2026-10-30 19:39:29.471770456 +0000 UTC m=+832.014577723"
Oct 30 19:39:29.495499 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:29.495463    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:29.501399 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:29.501372    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:29.588332 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:29.588292    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="85fd040f-5d0a-4b00-9eab-06056c925fd7" path="/var/lib/kubelet/pods/85fd040f-5d0a-4b00-9eab-06056c925fd7/volumes"
Oct 30 19:39:30.359795 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:30.359767    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:30.360936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:30.360917    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:39:31.757639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.757609    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:39:31.869159 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.869117    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:39:31.879355 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.879329    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-data\") pod \"8a917bdc-59d5-48aa-bd97-082055b0d932\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") "
Oct 30 19:39:31.879513 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.879361    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-podinfo\") pod \"8a917bdc-59d5-48aa-bd97-082055b0d932\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") "
Oct 30 19:39:31.879513 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.879432    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-kube-api-access-khq6k\" (UniqueName: \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-kube-api-access-khq6k\") pod \"8a917bdc-59d5-48aa-bd97-082055b0d932\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") "
Oct 30 19:39:31.879513 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.879481    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-credential-socket\") pod \"8a917bdc-59d5-48aa-bd97-082055b0d932\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") "
Oct 30 19:39:31.879643 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.879584    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a917bdc-59d5-48aa-bd97-082055b0d932-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a917bdc-59d5-48aa-bd97-082055b0d932-istiod-ca-cert\") pod \"8a917bdc-59d5-48aa-bd97-082055b0d932\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") "
Oct 30 19:39:31.879643 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.879611    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-token\" (UniqueName: \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-token\") pod \"8a917bdc-59d5-48aa-bd97-082055b0d932\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") "
Oct 30 19:39:31.879752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.879653    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-certs\") pod \"8a917bdc-59d5-48aa-bd97-082055b0d932\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") "
Oct 30 19:39:31.879752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.879655    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-data" pod "8a917bdc-59d5-48aa-bd97-082055b0d932" (UID: "8a917bdc-59d5-48aa-bd97-082055b0d932"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:39:31.879752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.879681    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-socket\") pod \"8a917bdc-59d5-48aa-bd97-082055b0d932\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") "
Oct 30 19:39:31.879752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.879723    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-envoy\") pod \"8a917bdc-59d5-48aa-bd97-082055b0d932\" (UID: \"8a917bdc-59d5-48aa-bd97-082055b0d932\") "
Oct 30 19:39:31.880041 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.880021    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-certs" pod "8a917bdc-59d5-48aa-bd97-082055b0d932" (UID: "8a917bdc-59d5-48aa-bd97-082055b0d932"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:39:31.880226 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.880157    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-credential-socket" pod "8a917bdc-59d5-48aa-bd97-082055b0d932" (UID: "8a917bdc-59d5-48aa-bd97-082055b0d932"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:39:31.880226 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.880171    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-socket" pod "8a917bdc-59d5-48aa-bd97-082055b0d932" (UID: "8a917bdc-59d5-48aa-bd97-082055b0d932"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:39:31.880226 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.880208    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a917bdc-59d5-48aa-bd97-082055b0d932-istiod-ca-cert" pod "8a917bdc-59d5-48aa-bd97-082055b0d932" (UID: "8a917bdc-59d5-48aa-bd97-082055b0d932"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:39:31.880442 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.880248    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:31.880442 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.880267    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:31.882150 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.882130    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-podinfo" pod "8a917bdc-59d5-48aa-bd97-082055b0d932" (UID: "8a917bdc-59d5-48aa-bd97-082055b0d932"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:39:31.882150 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.882145    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-envoy" pod "8a917bdc-59d5-48aa-bd97-082055b0d932" (UID: "8a917bdc-59d5-48aa-bd97-082055b0d932"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:39:31.882296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.882254    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-kube-api-access-khq6k" pod "8a917bdc-59d5-48aa-bd97-082055b0d932" (UID: "8a917bdc-59d5-48aa-bd97-082055b0d932"). InnerVolumeSpecName "kube-api-access-khq6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:39:31.882455 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.882439    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-token" pod "8a917bdc-59d5-48aa-bd97-082055b0d932" (UID: "8a917bdc-59d5-48aa-bd97-082055b0d932"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:39:31.981480 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.981390    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-kube-api-access-l2vgj\" (UniqueName: \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-kube-api-access-l2vgj\") pod \"0d322a36-2162-40e2-af60-0305d3923fb5\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") "
Oct 30 19:39:31.981480 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.981467    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-istio-token\" (UniqueName: \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-istio-token\") pod \"0d322a36-2162-40e2-af60-0305d3923fb5\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") "
Oct 30 19:39:31.981714 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.981500    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-envoy\") pod \"0d322a36-2162-40e2-af60-0305d3923fb5\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") "
Oct 30 19:39:31.981714 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.981557    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-certs\") pod \"0d322a36-2162-40e2-af60-0305d3923fb5\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") "
Oct 30 19:39:31.981714 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.981614    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0d322a36-2162-40e2-af60-0305d3923fb5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d322a36-2162-40e2-af60-0305d3923fb5-istio-podinfo\") pod \"0d322a36-2162-40e2-af60-0305d3923fb5\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") "
Oct 30 19:39:31.981714 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.981648    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-credential-socket\") pod \"0d322a36-2162-40e2-af60-0305d3923fb5\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") "
Oct 30 19:39:31.981714 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.981710    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-socket\") pod \"0d322a36-2162-40e2-af60-0305d3923fb5\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") "
Oct 30 19:39:31.982004 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.981741    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-data\") pod \"0d322a36-2162-40e2-af60-0305d3923fb5\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") "
Oct 30 19:39:31.982004 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.981770    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d322a36-2162-40e2-af60-0305d3923fb5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d322a36-2162-40e2-af60-0305d3923fb5-istiod-ca-cert\") pod \"0d322a36-2162-40e2-af60-0305d3923fb5\" (UID: \"0d322a36-2162-40e2-af60-0305d3923fb5\") "
Oct 30 19:39:31.982004 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.981976    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-certs" pod "0d322a36-2162-40e2-af60-0305d3923fb5" (UID: "0d322a36-2162-40e2-af60-0305d3923fb5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982268    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a917bdc-59d5-48aa-bd97-082055b0d932-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982295    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982309    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982332    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982333    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-data" pod "0d322a36-2162-40e2-af60-0305d3923fb5" (UID: "0d322a36-2162-40e2-af60-0305d3923fb5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982347    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a917bdc-59d5-48aa-bd97-082055b0d932-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982361    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khq6k\" (UniqueName: \"kubernetes.io/projected/8a917bdc-59d5-48aa-bd97-082055b0d932-kube-api-access-khq6k\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982385    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982398    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a917bdc-59d5-48aa-bd97-082055b0d932-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982361    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d322a36-2162-40e2-af60-0305d3923fb5-istiod-ca-cert" pod "0d322a36-2162-40e2-af60-0305d3923fb5" (UID: "0d322a36-2162-40e2-af60-0305d3923fb5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982401    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-credential-socket" pod "0d322a36-2162-40e2-af60-0305d3923fb5" (UID: "0d322a36-2162-40e2-af60-0305d3923fb5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:39:31.982441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.982445    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-socket" pod "0d322a36-2162-40e2-af60-0305d3923fb5" (UID: "0d322a36-2162-40e2-af60-0305d3923fb5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:39:31.984438 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.984405    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-envoy" pod "0d322a36-2162-40e2-af60-0305d3923fb5" (UID: "0d322a36-2162-40e2-af60-0305d3923fb5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:39:31.984561 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.984433    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-istio-token" pod "0d322a36-2162-40e2-af60-0305d3923fb5" (UID: "0d322a36-2162-40e2-af60-0305d3923fb5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:39:31.984776 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.984759    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d322a36-2162-40e2-af60-0305d3923fb5-istio-podinfo" pod "0d322a36-2162-40e2-af60-0305d3923fb5" (UID: "0d322a36-2162-40e2-af60-0305d3923fb5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:39:31.984868 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:31.984785    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-kube-api-access-l2vgj" pod "0d322a36-2162-40e2-af60-0305d3923fb5" (UID: "0d322a36-2162-40e2-af60-0305d3923fb5"). InnerVolumeSpecName "kube-api-access-l2vgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:39:32.084099 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.084059    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2vgj\" (UniqueName: \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-kube-api-access-l2vgj\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:32.084099 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.084102    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d322a36-2162-40e2-af60-0305d3923fb5-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:32.084308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.084119    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:32.084308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.084132    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d322a36-2162-40e2-af60-0305d3923fb5-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:32.084308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.084146    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:32.084308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.084159    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:32.084308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.084171    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d322a36-2162-40e2-af60-0305d3923fb5-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:32.084308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.084185    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d322a36-2162-40e2-af60-0305d3923fb5-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:32.286723 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.286634    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:32.371379 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.371345    6015 generic.go:356] "Generic (PLEG): container finished" podID="0d322a36-2162-40e2-af60-0305d3923fb5" containerID="881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775" exitCode=0
Oct 30 19:39:32.371595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.371432    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"
Oct 30 19:39:32.371595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.371567    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" event={"ID":"0d322a36-2162-40e2-af60-0305d3923fb5","Type":"ContainerDied","Data":"881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775"}
Oct 30 19:39:32.371748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.371616    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r" event={"ID":"0d322a36-2162-40e2-af60-0305d3923fb5","Type":"ContainerDied","Data":"4e31fa60a4015c8912239f5dff7b916b3559fcb095e98c11118f51d0ae4b0a7e"}
Oct 30 19:39:32.371748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.371648    6015 scope.go:122] "RemoveContainer" containerID="881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775"
Oct 30 19:39:32.374332 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.374296    6015 generic.go:356] "Generic (PLEG): container finished" podID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerID="86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04" exitCode=0
Oct 30 19:39:32.374468 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.374368    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" event={"ID":"8a917bdc-59d5-48aa-bd97-082055b0d932","Type":"ContainerDied","Data":"86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04"}
Oct 30 19:39:32.374468 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.374414    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"
Oct 30 19:39:32.374468 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.374424    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk" event={"ID":"8a917bdc-59d5-48aa-bd97-082055b0d932","Type":"ContainerDied","Data":"b839d8c171b29bcf913d167a10c95ba783028f81673d78737c3900801ed6f072"}
Oct 30 19:39:32.382941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.382705    6015 scope.go:122] "RemoveContainer" containerID="7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79"
Oct 30 19:39:32.392553 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.392525    6015 scope.go:122] "RemoveContainer" containerID="881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775"
Oct 30 19:39:32.392934 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:32.392914    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775\": container with ID starting with 881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775 not found: ID does not exist" containerID="881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775"
Oct 30 19:39:32.393001 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.392946    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775"} err="failed to get container status \"881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775\": rpc error: code = NotFound desc = could not find container \"881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775\": container with ID starting with 881a6814b0099b5a5903b28c632e10c5201cd95639242035e1a9ff5b921db775 not found: ID does not exist"
Oct 30 19:39:32.393001 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.392966    6015 scope.go:122] "RemoveContainer" containerID="7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79"
Oct 30 19:39:32.393257 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:32.393242    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79\": container with ID starting with 7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79 not found: ID does not exist" containerID="7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79"
Oct 30 19:39:32.393297 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.393261    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79"} err="failed to get container status \"7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79\": rpc error: code = NotFound desc = could not find container \"7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79\": container with ID starting with 7ca33db53f8cb8b3aba00911efd925c60ab0d9bd15211db510ae476c7e9aac79 not found: ID does not exist"
Oct 30 19:39:32.393297 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.393275    6015 scope.go:122] "RemoveContainer" containerID="86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04"
Oct 30 19:39:32.403071 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.403054    6015 scope.go:122] "RemoveContainer" containerID="4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a"
Oct 30 19:39:32.411715 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.411697    6015 scope.go:122] "RemoveContainer" containerID="86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04"
Oct 30 19:39:32.412033 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:32.412014    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04\": container with ID starting with 86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04 not found: ID does not exist" containerID="86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04"
Oct 30 19:39:32.412112 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.412041    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04"} err="failed to get container status \"86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04\": rpc error: code = NotFound desc = could not find container \"86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04\": container with ID starting with 86e5dbbba8a7ae5c4debf7e3f35c2f62e4688928838d50ebc31eb30b41395f04 not found: ID does not exist"
Oct 30 19:39:32.412112 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.412060    6015 scope.go:122] "RemoveContainer" containerID="4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a"
Oct 30 19:39:32.412306 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:32.412288    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a\": container with ID starting with 4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a not found: ID does not exist" containerID="4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a"
Oct 30 19:39:32.412345 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.412309    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a"} err="failed to get container status \"4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a\": rpc error: code = NotFound desc = could not find container \"4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a\": container with ID starting with 4009107b004e276b1734ba26b2c4c8d7bb03c2747eaaa40c11ae71740c439d2a not found: ID does not exist"
Oct 30 19:39:32.460025 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.459987    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:32.537211 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.537122    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"]
Oct 30 19:39:32.539783 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.539757    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-87e6ae88-openshift-default-6fc5bd8df-xmrwk"]
Oct 30 19:39:32.629947 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.629907    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:32.644698 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.644365    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"]
Oct 30 19:39:32.647020 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.646994    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5442f600-openshift-default-7ff99c56cf-qrb7r"]
Oct 30 19:39:32.904185 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:32.904153    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:33.072711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:33.072677    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:33.242087 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:33.241993    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:33.415984 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:33.415903    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:33.580796 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:33.580758    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:33.584416 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:33.584385    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" path="/var/lib/kubelet/pods/0d322a36-2162-40e2-af60-0305d3923fb5/volumes"
Oct 30 19:39:33.584923 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:33.584909    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" path="/var/lib/kubelet/pods/8a917bdc-59d5-48aa-bd97-082055b0d932/volumes"
Oct 30 19:39:36.911962 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:36.911924    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:37.107749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.107710    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:37.321266 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.321228    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"]
Oct 30 19:39:37.321639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.321627    6015 cpu_manager.go:414] "containerMap: removing container" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy"
Oct 30 19:39:37.321683 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.321641    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy"
Oct 30 19:39:37.321683 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.321661    6015 cpu_manager.go:414] "containerMap: removing container" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy"
Oct 30 19:39:37.321683 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.321667    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy"
Oct 30 19:39:37.321770 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.321744    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy"
Oct 30 19:39:37.321770 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.321755    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy"
Oct 30 19:39:37.321770 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.321763    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy"
Oct 30 19:39:37.326240 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.326216    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 19:39:37.379741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.379700    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"]
Oct 30 19:39:37.424405 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.424373    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-a74d15\""
Oct 30 19:39:37.424579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.424489    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-a74d15-dockercfg-gslc9\""
Oct 30 19:39:37.436120 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.436090    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0ae637e-40fc-4735-ae1f-d572a97b528d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j\" (UID: \"b0ae637e-40fc-4735-ae1f-d572a97b528d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 19:39:37.436303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.436163    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzb7h\" (UniqueName: \"kubernetes.io/projected/b0ae637e-40fc-4735-ae1f-d572a97b528d-kube-api-access-zzb7h\") pod \"payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j\" (UID: \"b0ae637e-40fc-4735-ae1f-d572a97b528d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 19:39:37.476645 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.476613    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"]
Oct 30 19:39:37.477052 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.477038    6015 cpu_manager.go:414] "containerMap: removing container" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy"
Oct 30 19:39:37.477106 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.477053    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a917bdc-59d5-48aa-bd97-082055b0d932" containerName="istio-proxy"
Oct 30 19:39:37.477106 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.477090    6015 cpu_manager.go:414] "containerMap: removing container" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy"
Oct 30 19:39:37.477106 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.477095    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy"
Oct 30 19:39:37.477194 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.477165    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d322a36-2162-40e2-af60-0305d3923fb5" containerName="istio-proxy"
Oct 30 19:39:37.480577 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.480541    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 19:39:37.535866 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.535830    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"]
Oct 30 19:39:37.537124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.537095    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzb7h\" (UniqueName: \"kubernetes.io/projected/b0ae637e-40fc-4735-ae1f-d572a97b528d-kube-api-access-zzb7h\") pod \"payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j\" (UID: \"b0ae637e-40fc-4735-ae1f-d572a97b528d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 19:39:37.537267 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.537222    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0ae637e-40fc-4735-ae1f-d572a97b528d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j\" (UID: \"b0ae637e-40fc-4735-ae1f-d572a97b528d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 19:39:37.585214 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.585142    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-a74d15\""
Oct 30 19:39:37.589874 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.588747    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0ae637e-40fc-4735-ae1f-d572a97b528d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j\" (UID: \"b0ae637e-40fc-4735-ae1f-d572a97b528d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 19:39:37.597384 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.597350    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzb7h\" (UniqueName: \"kubernetes.io/projected/b0ae637e-40fc-4735-ae1f-d572a97b528d-kube-api-access-zzb7h\") pod \"payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j\" (UID: \"b0ae637e-40fc-4735-ae1f-d572a97b528d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 19:39:37.638489 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.638450    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qtgn\" (UniqueName: \"kubernetes.io/projected/79d59373-dd54-4099-9aa8-95b27ebb3ca8-kube-api-access-6qtgn\") pod \"payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg\" (UID: \"79d59373-dd54-4099-9aa8-95b27ebb3ca8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 19:39:37.638675 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.638543    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79d59373-dd54-4099-9aa8-95b27ebb3ca8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg\" (UID: \"79d59373-dd54-4099-9aa8-95b27ebb3ca8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 19:39:37.687008 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.686987    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-a74d15-dockercfg-gslc9\""
Oct 30 19:39:37.688636 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.688620    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 19:39:37.739420 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.739382    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qtgn\" (UniqueName: \"kubernetes.io/projected/79d59373-dd54-4099-9aa8-95b27ebb3ca8-kube-api-access-6qtgn\") pod \"payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg\" (UID: \"79d59373-dd54-4099-9aa8-95b27ebb3ca8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 19:39:37.739613 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.739442    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79d59373-dd54-4099-9aa8-95b27ebb3ca8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg\" (UID: \"79d59373-dd54-4099-9aa8-95b27ebb3ca8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 19:39:37.740242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.740214    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79d59373-dd54-4099-9aa8-95b27ebb3ca8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg\" (UID: \"79d59373-dd54-4099-9aa8-95b27ebb3ca8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 19:39:37.798390 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:37.798356    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qtgn\" (UniqueName: \"kubernetes.io/projected/79d59373-dd54-4099-9aa8-95b27ebb3ca8-kube-api-access-6qtgn\") pod \"payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg\" (UID: \"79d59373-dd54-4099-9aa8-95b27ebb3ca8\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 19:39:38.060043 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:38.059957    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"]
Oct 30 19:39:38.093943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:38.093893    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 19:39:38.408064 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:38.407954    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j" event={"ID":"b0ae637e-40fc-4735-ae1f-d572a97b528d","Type":"ContainerStarted","Data":"5f1459bbc5d00b28005c52002e37c8c43ce0dfa95e584f8b6b4aacf355854897"}
Oct 30 19:39:38.408241 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:38.408066    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j" event={"ID":"b0ae637e-40fc-4735-ae1f-d572a97b528d","Type":"ContainerStarted","Data":"d579e9ca9f8f6a2f69ff0bcde70094d755118a44ef94feb6c021404d69011a84"}
Oct 30 19:39:38.408241 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:38.408101    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 19:39:38.470642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:38.470618    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"]
Oct 30 19:39:38.473424 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:39:38.473377    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d59373_dd54_4099_9aa8_95b27ebb3ca8.slice/crio-4371c25d6595475c1ffdd6db5ee6fe4b5a5b0202694b5ba564fc2b4746ef508d WatchSource:0}: Error finding container 4371c25d6595475c1ffdd6db5ee6fe4b5a5b0202694b5ba564fc2b4746ef508d: Status 404 returned error can't find the container with id 4371c25d6595475c1ffdd6db5ee6fe4b5a5b0202694b5ba564fc2b4746ef508d
Oct 30 19:39:38.520083 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:38.520016    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j" podStartSLOduration=1.520003166 podStartE2EDuration="1.520003166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:39:38.518380462 +0000 UTC m=+841.061187726" watchObservedRunningTime="2026-10-30 19:39:38.520003166 +0000 UTC m=+841.062810430"
Oct 30 19:39:39.415318 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:39.415278    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg" event={"ID":"79d59373-dd54-4099-9aa8-95b27ebb3ca8","Type":"ContainerStarted","Data":"dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08"}
Oct 30 19:39:39.415881 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:39.415340    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg" event={"ID":"79d59373-dd54-4099-9aa8-95b27ebb3ca8","Type":"ContainerStarted","Data":"4371c25d6595475c1ffdd6db5ee6fe4b5a5b0202694b5ba564fc2b4746ef508d"}
Oct 30 19:39:39.415881 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:39.415371    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 19:39:39.501227 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:39.501173    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:39.525726 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:39.525654    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg" podStartSLOduration=2.525634512 podStartE2EDuration="2.525634512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:39:39.525310901 +0000 UTC m=+842.068118166" watchObservedRunningTime="2026-10-30 19:39:39.525634512 +0000 UTC m=+842.068441781"
Oct 30 19:39:39.700342 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:39.700243    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:39.917477 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:39.917441    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"]
Oct 30 19:39:39.921296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:39.921275    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 19:39:39.970742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:39.970646    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-4ec609\""
Oct 30 19:39:39.987953 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:39.987922    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-4ec609-dockercfg-dlpnj\""
Oct 30 19:39:39.989469 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:39.989444    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"]
Oct 30 19:39:40.062135 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.062103    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"]
Oct 30 19:39:40.063863 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.063834    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54a968f-61c5-4a4f-a7b1-6764c5828d89-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57\" (UID: \"b54a968f-61c5-4a4f-a7b1-6764c5828d89\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 19:39:40.063996 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.063903    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6dr9\" (UniqueName: \"kubernetes.io/projected/b54a968f-61c5-4a4f-a7b1-6764c5828d89-kube-api-access-s6dr9\") pod \"payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57\" (UID: \"b54a968f-61c5-4a4f-a7b1-6764c5828d89\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 19:39:40.065615 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.065600    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 19:39:40.118755 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.118722    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"]
Oct 30 19:39:40.164677 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.164644    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54a968f-61c5-4a4f-a7b1-6764c5828d89-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57\" (UID: \"b54a968f-61c5-4a4f-a7b1-6764c5828d89\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 19:39:40.164677 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.164684    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0abbe2cc-d0e2-4504-893c-698a1e1c246c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4\" (UID: \"0abbe2cc-d0e2-4504-893c-698a1e1c246c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 19:39:40.164943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.164708    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgrn6\" (UniqueName: \"kubernetes.io/projected/0abbe2cc-d0e2-4504-893c-698a1e1c246c-kube-api-access-sgrn6\") pod \"payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4\" (UID: \"0abbe2cc-d0e2-4504-893c-698a1e1c246c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 19:39:40.164943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.164794    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6dr9\" (UniqueName: \"kubernetes.io/projected/b54a968f-61c5-4a4f-a7b1-6764c5828d89-kube-api-access-s6dr9\") pod \"payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57\" (UID: \"b54a968f-61c5-4a4f-a7b1-6764c5828d89\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 19:39:40.165422 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.165401    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54a968f-61c5-4a4f-a7b1-6764c5828d89-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57\" (UID: \"b54a968f-61c5-4a4f-a7b1-6764c5828d89\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 19:39:40.224161 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.224088    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6dr9\" (UniqueName: \"kubernetes.io/projected/b54a968f-61c5-4a4f-a7b1-6764c5828d89-kube-api-access-s6dr9\") pod \"payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57\" (UID: \"b54a968f-61c5-4a4f-a7b1-6764c5828d89\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 19:39:40.234940 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.234912    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 19:39:40.266444 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.266408    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0abbe2cc-d0e2-4504-893c-698a1e1c246c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4\" (UID: \"0abbe2cc-d0e2-4504-893c-698a1e1c246c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 19:39:40.266444 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.266447    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrn6\" (UniqueName: \"kubernetes.io/projected/0abbe2cc-d0e2-4504-893c-698a1e1c246c-kube-api-access-sgrn6\") pod \"payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4\" (UID: \"0abbe2cc-d0e2-4504-893c-698a1e1c246c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 19:39:40.267159 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.267140    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0abbe2cc-d0e2-4504-893c-698a1e1c246c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4\" (UID: \"0abbe2cc-d0e2-4504-893c-698a1e1c246c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 19:39:40.325481 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.325446    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgrn6\" (UniqueName: \"kubernetes.io/projected/0abbe2cc-d0e2-4504-893c-698a1e1c246c-kube-api-access-sgrn6\") pod \"payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4\" (UID: \"0abbe2cc-d0e2-4504-893c-698a1e1c246c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 19:39:40.378781 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.378744    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 19:39:40.609509 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.609482    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"]
Oct 30 19:39:40.611874 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:39:40.611845    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54a968f_61c5_4a4f_a7b1_6764c5828d89.slice/crio-6b2a26d61a8aa89a9fb333a9837566ef8938c0860e2348f32a1fe7d58f97ad23 WatchSource:0}: Error finding container 6b2a26d61a8aa89a9fb333a9837566ef8938c0860e2348f32a1fe7d58f97ad23: Status 404 returned error can't find the container with id 6b2a26d61a8aa89a9fb333a9837566ef8938c0860e2348f32a1fe7d58f97ad23
Oct 30 19:39:40.748104 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:40.748072    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"]
Oct 30 19:39:40.751173 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:39:40.751146    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0abbe2cc_d0e2_4504_893c_698a1e1c246c.slice/crio-ec9af8b33c054becb714279cfba187394f07243f5c696616a5b9ffcc4720d4e4 WatchSource:0}: Error finding container ec9af8b33c054becb714279cfba187394f07243f5c696616a5b9ffcc4720d4e4: Status 404 returned error can't find the container with id ec9af8b33c054becb714279cfba187394f07243f5c696616a5b9ffcc4720d4e4
Oct 30 19:39:41.001868 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:41.001756    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:41.198869 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:41.198832    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:41.434536 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:41.434493    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57" event={"ID":"b54a968f-61c5-4a4f-a7b1-6764c5828d89","Type":"ContainerStarted","Data":"4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24"}
Oct 30 19:39:41.434839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:41.434770    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 19:39:41.434839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:41.434831    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57" event={"ID":"b54a968f-61c5-4a4f-a7b1-6764c5828d89","Type":"ContainerStarted","Data":"6b2a26d61a8aa89a9fb333a9837566ef8938c0860e2348f32a1fe7d58f97ad23"}
Oct 30 19:39:41.436294 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:41.436266    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4" event={"ID":"0abbe2cc-d0e2-4504-893c-698a1e1c246c","Type":"ContainerStarted","Data":"0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5"}
Oct 30 19:39:41.436420 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:41.436308    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4" event={"ID":"0abbe2cc-d0e2-4504-893c-698a1e1c246c","Type":"ContainerStarted","Data":"ec9af8b33c054becb714279cfba187394f07243f5c696616a5b9ffcc4720d4e4"}
Oct 30 19:39:41.436420 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:41.436347    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 19:39:41.545373 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:41.545303    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57" podStartSLOduration=2.545285028 podStartE2EDuration="2.545285028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:39:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:39:41.544718116 +0000 UTC m=+844.087525381" watchObservedRunningTime="2026-10-30 19:39:41.545285028 +0000 UTC m=+844.088092296"
Oct 30 19:39:41.656201 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:41.656151    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4" podStartSLOduration=1.656136815 podStartE2EDuration="1.656136815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:39:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:39:41.65501705 +0000 UTC m=+844.197824334" watchObservedRunningTime="2026-10-30 19:39:41.656136815 +0000 UTC m=+844.198944080"
Oct 30 19:39:42.605987 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:42.605947    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:42.860336 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:42.860240    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:43.050473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:43.050440    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:43.205610 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:43.205518    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:44.009010 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.008969    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:44.535044 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.535011    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"]
Oct 30 19:39:44.539006 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.538986    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.589663 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.589626    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-b0a183-openshift-default-dockercfg-hjv6k\""
Oct 30 19:39:44.638903 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.638868    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"]
Oct 30 19:39:44.711656 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.711624    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6fg8\" (UniqueName: \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-kube-api-access-g6fg8\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.711656 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.711659    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-podinfo\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.711944 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.711681    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istiod-ca-cert\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.712070 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.712043    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-envoy\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.712196 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.712101    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.712257 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.712200    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-certs\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.712360 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.712338    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-token\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.712455 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.712382    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-data\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.712455 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.712409    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-credential-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.813552 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.813519    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-envoy\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.813748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.813568    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.813748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.813599    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-certs\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.813748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.813650    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-token\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.813748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.813691    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-data\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.813748 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.813719    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-credential-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.814056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.813761    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6fg8\" (UniqueName: \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-kube-api-access-g6fg8\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.814056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.813940    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-podinfo\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.814056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.813983    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istiod-ca-cert\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.814056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.814041    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.814334 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.814304    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-data\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.814549 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.814521    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-credential-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.814675 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.814596    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-certs\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.814747 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.814733    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istiod-ca-cert\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.816065 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.816041    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-envoy\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.816823 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.816787    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-podinfo\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.872417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.872381    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-token\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:44.872667 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:44.872647    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6fg8\" (UniqueName: \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-kube-api-access-g6fg8\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:45.153513 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:45.153424    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:45.230355 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:45.230327    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:45.576003 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:45.575940    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"]
Oct 30 19:39:45.578690 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:39:45.578664    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e325c6_3061_4f98_80e8_3d95a9c2896c.slice/crio-d422645b6b4fb2f07f3618c391d57607b8b2d2680ebaae2eecdaffa18b4f7478 WatchSource:0}: Error finding container d422645b6b4fb2f07f3618c391d57607b8b2d2680ebaae2eecdaffa18b4f7478: Status 404 returned error can't find the container with id d422645b6b4fb2f07f3618c391d57607b8b2d2680ebaae2eecdaffa18b4f7478
Oct 30 19:39:45.581448 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:45.581415    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:39:45.581544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:45.581482    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:39:45.581544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:45.581514    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:39:46.463322 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:46.463284    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" event={"ID":"a1e325c6-3061-4f98-80e8-3d95a9c2896c","Type":"ContainerStarted","Data":"4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27"}
Oct 30 19:39:46.463776 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:46.463343    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" event={"ID":"a1e325c6-3061-4f98-80e8-3d95a9c2896c","Type":"ContainerStarted","Data":"d422645b6b4fb2f07f3618c391d57607b8b2d2680ebaae2eecdaffa18b4f7478"}
Oct 30 19:39:46.628361 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:46.628296    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" podStartSLOduration=2.628275599 podStartE2EDuration="2.628275599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:39:46.627641103 +0000 UTC m=+849.170448366" watchObservedRunningTime="2026-10-30 19:39:46.628275599 +0000 UTC m=+849.171082865"
Oct 30 19:39:47.154492 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.154449    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:47.160073 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.160048    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:47.441756 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.441664    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"]
Oct 30 19:39:47.446335 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.446298    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.468796 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.468760    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:47.470122 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.470096    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:39:47.505046 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.505013    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-a74d15-serving-cert\""
Oct 30 19:39:47.506948 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.506887    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"]
Oct 30 19:39:47.541337 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.541299    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.541543 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.541400    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6m29\" (UniqueName: \"kubernetes.io/projected/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-kube-api-access-l6m29\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.541608 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.541544    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-metrics-certs\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.541665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.541606    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.643073 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.643030    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6m29\" (UniqueName: \"kubernetes.io/projected/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-kube-api-access-l6m29\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.644959 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.643109    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-metrics-certs\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.644959 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.643156    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.644959 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.643291    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.644959 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:47.643433    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-serving-cert: secret "maas-api-e2e-worker-w0-a74d15-serving-cert" not found
Oct 30 19:39:47.644959 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:47.643497    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-maas-api-tls podName:0d2a4c5c-7251-45b8-a501-fea6546bc5d7 nodeName:}" failed. No retries permitted until 2026-10-30 19:39:48.143474926 +0000 UTC m=+850.686282173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-maas-api-tls") pod "maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm" (UID: "0d2a4c5c-7251-45b8-a501-fea6546bc5d7") : secret "maas-api-e2e-worker-w0-a74d15-serving-cert" not found
Oct 30 19:39:47.644959 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.644160    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.646084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.646055    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-metrics-certs\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.673842 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.673789    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:47.712312 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.712234    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6m29\" (UniqueName: \"kubernetes.io/projected/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-kube-api-access-l6m29\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:47.871452 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:47.871415    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:48.148592 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:48.148559    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:48.151164 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:48.151136    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:48.362875 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:48.362833    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:48.734836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:48.734785    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"]
Oct 30 19:39:48.737119 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:39:48.737093    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2a4c5c_7251_45b8_a501_fea6546bc5d7.slice/crio-9721233d00614008d1680ef3044fafb5771d835cf250327e8aa18a79b66e2e8b WatchSource:0}: Error finding container 9721233d00614008d1680ef3044fafb5771d835cf250327e8aa18a79b66e2e8b: Status 404 returned error can't find the container with id 9721233d00614008d1680ef3044fafb5771d835cf250327e8aa18a79b66e2e8b
Oct 30 19:39:49.418329 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:49.418290    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 19:39:49.437093 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:49.437048    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:49.479301 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:49.479269    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm" event={"ID":"0d2a4c5c-7251-45b8-a501-fea6546bc5d7","Type":"ContainerStarted","Data":"9721233d00614008d1680ef3044fafb5771d835cf250327e8aa18a79b66e2e8b"}
Oct 30 19:39:49.662304 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:49.662276    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:50.425998 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:50.425971    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 19:39:50.485710 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:50.485677    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm" event={"ID":"0d2a4c5c-7251-45b8-a501-fea6546bc5d7","Type":"ContainerStarted","Data":"b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8"}
Oct 30 19:39:50.485901 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:50.485746    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:50.650869 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:50.650767    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm" podStartSLOduration=2.80825529 podStartE2EDuration="3.65074588s" totalImagesPullingTime="842.49059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:39:50.649707014 +0000 UTC m=+853.192514280" watchObservedRunningTime="2026-10-30 19:39:50.65074588 +0000 UTC m=+853.193553146"
Oct 30 19:39:52.445389 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:52.445360    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 19:39:52.445942 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:52.445442    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 19:39:52.657742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:52.657699    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:52.812754 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:52.812716    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:52.962859 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:52.962827    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:53.099714 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.099623    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"]
Oct 30 19:39:53.103567 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.103544    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 19:39:53.153001 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.152968    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-b0a183\""
Oct 30 19:39:53.153351 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.153333    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-b0a183-dockercfg-4ld9w\""
Oct 30 19:39:53.199791 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.199753    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/485ec003-a8a7-412f-949e-7a96cf8b521c-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk\" (UID: \"485ec003-a8a7-412f-949e-7a96cf8b521c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 19:39:53.200019 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.199911    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtz4c\" (UniqueName: \"kubernetes.io/projected/485ec003-a8a7-412f-949e-7a96cf8b521c-kube-api-access-vtz4c\") pod \"payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk\" (UID: \"485ec003-a8a7-412f-949e-7a96cf8b521c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 19:39:53.201244 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.201219    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"]
Oct 30 19:39:53.300658 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.300618    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtz4c\" (UniqueName: \"kubernetes.io/projected/485ec003-a8a7-412f-949e-7a96cf8b521c-kube-api-access-vtz4c\") pod \"payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk\" (UID: \"485ec003-a8a7-412f-949e-7a96cf8b521c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 19:39:53.300898 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.300740    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/485ec003-a8a7-412f-949e-7a96cf8b521c-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk\" (UID: \"485ec003-a8a7-412f-949e-7a96cf8b521c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 19:39:53.301455 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.301430    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/485ec003-a8a7-412f-949e-7a96cf8b521c-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk\" (UID: \"485ec003-a8a7-412f-949e-7a96cf8b521c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 19:39:53.360341 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.360261    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtz4c\" (UniqueName: \"kubernetes.io/projected/485ec003-a8a7-412f-949e-7a96cf8b521c-kube-api-access-vtz4c\") pod \"payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk\" (UID: \"485ec003-a8a7-412f-949e-7a96cf8b521c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 19:39:53.416866 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.416801    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 19:39:53.785574 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:53.785550    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"]
Oct 30 19:39:53.788263 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:39:53.788231    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485ec003_a8a7_412f_949e_7a96cf8b521c.slice/crio-840331a8106691664679533c87c525a6da6055413347b6c657a38f073c7a9f74 WatchSource:0}: Error finding container 840331a8106691664679533c87c525a6da6055413347b6c657a38f073c7a9f74: Status 404 returned error can't find the container with id 840331a8106691664679533c87c525a6da6055413347b6c657a38f073c7a9f74
Oct 30 19:39:54.510169 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:54.510132    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk" event={"ID":"485ec003-a8a7-412f-949e-7a96cf8b521c","Type":"ContainerStarted","Data":"4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17"}
Oct 30 19:39:54.510169 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:54.510184    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk" event={"ID":"485ec003-a8a7-412f-949e-7a96cf8b521c","Type":"ContainerStarted","Data":"840331a8106691664679533c87c525a6da6055413347b6c657a38f073c7a9f74"}
Oct 30 19:39:54.510465 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:54.510226    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 19:39:54.622271 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:54.622213    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk" podStartSLOduration=1.622193943 podStartE2EDuration="1.622193943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:39:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:39:54.620410718 +0000 UTC m=+857.163218007" watchObservedRunningTime="2026-10-30 19:39:54.622193943 +0000 UTC m=+857.165001208"
Oct 30 19:39:56.496832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:56.496779    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 19:39:57.037972 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:57.037934    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:57.993792 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:57.993752    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"]
Oct 30 19:39:57.994265 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:57.994040    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh" podUID="06140817-652d-4733-bdba-645a70710dfc" containerName="maas-api" containerID="cri-o://a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3" gracePeriod=30
Oct 30 19:39:58.099430 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.099340    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:58.140068 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.140030    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh" podUID="06140817-652d-4733-bdba-645a70710dfc" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Oct 30 19:39:58.228477 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:58.228442    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:39:58.266007 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.265981    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:39:58.355060 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.355027    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06140817-652d-4733-bdba-645a70710dfc-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06140817-652d-4733-bdba-645a70710dfc-openshift-service-ca\") pod \"06140817-652d-4733-bdba-645a70710dfc\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") "
Oct 30 19:39:58.355260 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.355124    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06140817-652d-4733-bdba-645a70710dfc-kube-api-access-tdxwk\" (UniqueName: \"kubernetes.io/projected/06140817-652d-4733-bdba-645a70710dfc-kube-api-access-tdxwk\") pod \"06140817-652d-4733-bdba-645a70710dfc\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") "
Oct 30 19:39:58.355260 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.355214    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-maas-api-tls\") pod \"06140817-652d-4733-bdba-645a70710dfc\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") "
Oct 30 19:39:58.355384 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.355276    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-metrics-certs\" (UniqueName: \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-metrics-certs\") pod \"06140817-652d-4733-bdba-645a70710dfc\" (UID: \"06140817-652d-4733-bdba-645a70710dfc\") "
Oct 30 19:39:58.355494 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.355469    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06140817-652d-4733-bdba-645a70710dfc-openshift-service-ca" pod "06140817-652d-4733-bdba-645a70710dfc" (UID: "06140817-652d-4733-bdba-645a70710dfc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:39:58.355663 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.355642    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06140817-652d-4733-bdba-645a70710dfc-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:58.357517 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.357485    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-maas-api-tls" pod "06140817-652d-4733-bdba-645a70710dfc" (UID: "06140817-652d-4733-bdba-645a70710dfc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:39:58.357517 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.357503    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06140817-652d-4733-bdba-645a70710dfc-kube-api-access-tdxwk" pod "06140817-652d-4733-bdba-645a70710dfc" (UID: "06140817-652d-4733-bdba-645a70710dfc"). InnerVolumeSpecName "kube-api-access-tdxwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:39:58.357673 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.357569    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-metrics-certs" pod "06140817-652d-4733-bdba-645a70710dfc" (UID: "06140817-652d-4733-bdba-645a70710dfc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:39:58.453629 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.453576    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:58.456899 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.456855    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:58.456899 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.456888    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06140817-652d-4733-bdba-645a70710dfc-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:58.457131 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.456905    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdxwk\" (UniqueName: \"kubernetes.io/projected/06140817-652d-4733-bdba-645a70710dfc-kube-api-access-tdxwk\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:39:58.532566 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.532477    6015 generic.go:356] "Generic (PLEG): container finished" podID="06140817-652d-4733-bdba-645a70710dfc" containerID="a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3" exitCode=0
Oct 30 19:39:58.532566 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.532533    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"
Oct 30 19:39:58.532754 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.532565    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh" event={"ID":"06140817-652d-4733-bdba-645a70710dfc","Type":"ContainerDied","Data":"a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3"}
Oct 30 19:39:58.532754 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.532634    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh" event={"ID":"06140817-652d-4733-bdba-645a70710dfc","Type":"ContainerDied","Data":"ca68aee8f10ea0451417f0fd06f1bc3831c97ce20d411fec75a5af73f6b2d64a"}
Oct 30 19:39:58.532754 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.532665    6015 scope.go:122] "RemoveContainer" containerID="a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3"
Oct 30 19:39:58.546029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.544915    6015 scope.go:122] "RemoveContainer" containerID="a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3"
Oct 30 19:39:58.546029 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:39:58.545231    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3\": container with ID starting with a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3 not found: ID does not exist" containerID="a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3"
Oct 30 19:39:58.546029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.545258    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3"} err="failed to get container status \"a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3\": rpc error: code = NotFound desc = could not find container \"a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3\": container with ID starting with a3ca579f89eb6ed09ab88f67808bfacac5d2e6a60c6ed4fd248066df19f436f3 not found: ID does not exist"
Oct 30 19:39:58.697557 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.697522    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"]
Oct 30 19:39:58.705741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.705713    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-be15b010-754f87dd4f-kfxqh"]
Oct 30 19:39:58.815296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:58.815263    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:59.080764 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:59.080677    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:59.605263 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:59.605226    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06140817-652d-4733-bdba-645a70710dfc" path="/var/lib/kubelet/pods/06140817-652d-4733-bdba-645a70710dfc/volumes"
Oct 30 19:39:59.642472 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:59.642432    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:59.842995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:59.842961    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:39:59.999616 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:39:59.999527    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:00.397907 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:00.397860    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:00.587642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:00.587589    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:00.738852 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:00.738720    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:00.897238 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:00.897205    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:01.551989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:01.551951    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:02.191642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:02.191561    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:02.537149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:02.537050    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:04.626105 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.626072    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"]
Oct 30 19:40:04.626551 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.626536    6015 cpu_manager.go:414] "containerMap: removing container" podUID="06140817-652d-4733-bdba-645a70710dfc" containerName="maas-api"
Oct 30 19:40:04.626594 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.626553    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06140817-652d-4733-bdba-645a70710dfc" containerName="maas-api"
Oct 30 19:40:04.626650 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.626641    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="06140817-652d-4733-bdba-645a70710dfc" containerName="maas-api"
Oct 30 19:40:04.631307 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.631285    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:04.689772 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.689737    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"]
Oct 30 19:40:04.734312 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.734277    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-b0a183-serving-cert\""
Oct 30 19:40:04.752234 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.752201    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-metrics-certs\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:04.752412 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.752257    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj2tf\" (UniqueName: \"kubernetes.io/projected/6a4a9b41-40f4-441f-a376-80da3002123d-kube-api-access-sj2tf\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:04.752485 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.752463    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4a9b41-40f4-441f-a376-80da3002123d-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:04.752535 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.752503    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:04.827323 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.827290    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:04.853482 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.853444    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-metrics-certs\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:04.853664 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.853505    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj2tf\" (UniqueName: \"kubernetes.io/projected/6a4a9b41-40f4-441f-a376-80da3002123d-kube-api-access-sj2tf\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:04.853664 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.853620    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4a9b41-40f4-441f-a376-80da3002123d-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:04.853664 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.853646    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:04.853884 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:40:04.853862    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-serving-cert: secret "maas-api-e2e-worker-w2-b0a183-serving-cert" not found
Oct 30 19:40:04.853962 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:40:04.853955    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-maas-api-tls podName:6a4a9b41-40f4-441f-a376-80da3002123d nodeName:}" failed. No retries permitted until 2026-10-30 19:40:05.353933432 +0000 UTC m=+867.896740688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-maas-api-tls") pod "maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d" (UID: "6a4a9b41-40f4-441f-a376-80da3002123d") : secret "maas-api-e2e-worker-w2-b0a183-serving-cert" not found
Oct 30 19:40:04.854478 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.854450    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4a9b41-40f4-441f-a376-80da3002123d-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:04.856356 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.856331    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-metrics-certs\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:04.914981 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:04.914904    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj2tf\" (UniqueName: \"kubernetes.io/projected/6a4a9b41-40f4-441f-a376-80da3002123d-kube-api-access-sj2tf\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:05.015008 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:05.014948    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:05.345793 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:05.345760    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:05.360063 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:05.360022    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:05.362866 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:05.362826    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:05.516501 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:05.516411    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:05.520085 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:05.520055    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 19:40:05.547572 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:05.547533    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:05.695544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:05.695480    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:05.939463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:05.939375    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"]
Oct 30 19:40:05.942794 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:40:05.942765    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4a9b41_40f4_441f_a376_80da3002123d.slice/crio-584b343d4ba1d4b296abad2e704c3fd5313c23ea20c13242bcf4b30c23db5fed WatchSource:0}: Error finding container 584b343d4ba1d4b296abad2e704c3fd5313c23ea20c13242bcf4b30c23db5fed: Status 404 returned error can't find the container with id 584b343d4ba1d4b296abad2e704c3fd5313c23ea20c13242bcf4b30c23db5fed
Oct 30 19:40:06.581534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:06.581498    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d" event={"ID":"6a4a9b41-40f4-441f-a376-80da3002123d","Type":"ContainerStarted","Data":"584b343d4ba1d4b296abad2e704c3fd5313c23ea20c13242bcf4b30c23db5fed"}
Oct 30 19:40:07.589963 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:07.589904    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d" event={"ID":"6a4a9b41-40f4-441f-a376-80da3002123d","Type":"ContainerStarted","Data":"814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f"}
Oct 30 19:40:07.590576 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:07.590067    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:07.705530 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:07.705455    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d" podStartSLOduration=2.860637004 podStartE2EDuration="3.705435026s" totalImagesPullingTime="844.798022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:40:07.704691404 +0000 UTC m=+870.247498672" watchObservedRunningTime="2026-10-30 19:40:07.705435026 +0000 UTC m=+870.248242291"
Oct 30 19:40:07.972519 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:07.972486    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:08.176393 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:08.176287    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:08.596288 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:08.596252    6015 generic.go:356] "Generic (PLEG): container finished" podID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerID="6216f09f6f1cab5d21904fc02ca912482d4326f6b757e87aa13781e045549e4a" exitCode=0
Oct 30 19:40:08.596795 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:08.596328    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" event={"ID":"04256a40-3e15-4ed9-be3e-ec7aa0c882e4","Type":"ContainerDied","Data":"6216f09f6f1cab5d21904fc02ca912482d4326f6b757e87aa13781e045549e4a"}
Oct 30 19:40:08.596897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:08.596800    6015 scope.go:122] "RemoveContainer" containerID="6216f09f6f1cab5d21904fc02ca912482d4326f6b757e87aa13781e045549e4a"
Oct 30 19:40:08.597946 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:08.597923    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:40:08.598039 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:08.597985    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:40:08.598039 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:08.598016    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:40:08.684336 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:08.684303    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:08.839534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:08.839483    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:09.604055 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:09.604020    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" event={"ID":"04256a40-3e15-4ed9-be3e-ec7aa0c882e4","Type":"ContainerStarted","Data":"e34de0779cec1e30fb0f9876ee78ce2289cf1b2af9489c4e22add66740a34ea4"}
Oct 30 19:40:10.189909 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:10.187483    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:10.495654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:10.495564    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:40:10.495839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:10.495768    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Oct 30 19:40:10.495902 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:10.495829    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Oct 30 19:40:11.496507 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:11.496470    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Oct 30 19:40:11.497069 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:11.496536    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Oct 30 19:40:12.495430 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:12.495394    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Oct 30 19:40:12.495641 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:12.495455    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Oct 30 19:40:13.495831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:13.495769    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Oct 30 19:40:13.496258 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:13.495861    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Oct 30 19:40:13.602485 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:13.602459    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 19:40:14.495860 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:14.495823    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Oct 30 19:40:14.496274 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:14.495904    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Oct 30 19:40:15.144746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:15.144708    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:15.360491 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:15.360446    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:40:15.500599 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:15.500525    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:40:15.639276 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:15.639248    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:40:17.721351 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:17.721307    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:18.311752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:18.311718    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:18.521844 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:18.521776    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:18.687108 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:18.687010    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:18.825558 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:18.825520    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"]
Oct 30 19:40:18.829833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:18.829795    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 19:40:18.884996 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:18.884966    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"]
Oct 30 19:40:18.930184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:18.928939    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-98a19b\""
Oct 30 19:40:18.930184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:18.929087    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-98a19b-dockercfg-pnfkq\""
Oct 30 19:40:19.009389 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:19.009291    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtqrx\" (UniqueName: \"kubernetes.io/projected/3e8dca38-1009-42b6-b5e4-e635ba755eaa-kube-api-access-dtqrx\") pod \"payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v\" (UID: \"3e8dca38-1009-42b6-b5e4-e635ba755eaa\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 19:40:19.009389 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:19.009336    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8dca38-1009-42b6-b5e4-e635ba755eaa-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v\" (UID: \"3e8dca38-1009-42b6-b5e4-e635ba755eaa\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 19:40:19.110398 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:19.110365    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtqrx\" (UniqueName: \"kubernetes.io/projected/3e8dca38-1009-42b6-b5e4-e635ba755eaa-kube-api-access-dtqrx\") pod \"payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v\" (UID: \"3e8dca38-1009-42b6-b5e4-e635ba755eaa\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 19:40:19.110610 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:19.110408    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8dca38-1009-42b6-b5e4-e635ba755eaa-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v\" (UID: \"3e8dca38-1009-42b6-b5e4-e635ba755eaa\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 19:40:19.111161 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:19.111137    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8dca38-1009-42b6-b5e4-e635ba755eaa-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v\" (UID: \"3e8dca38-1009-42b6-b5e4-e635ba755eaa\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 19:40:19.192833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:19.192080    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtqrx\" (UniqueName: \"kubernetes.io/projected/3e8dca38-1009-42b6-b5e4-e635ba755eaa-kube-api-access-dtqrx\") pod \"payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v\" (UID: \"3e8dca38-1009-42b6-b5e4-e635ba755eaa\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 19:40:19.442356 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:19.442304    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 19:40:19.835630 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:19.835602    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"]
Oct 30 19:40:19.838078 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:40:19.838048    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8dca38_1009_42b6_b5e4_e635ba755eaa.slice/crio-52cb26d250d231d999cf8ca0c1f1905222f9c7f7baf2225ea7d85beefdf49050 WatchSource:0}: Error finding container 52cb26d250d231d999cf8ca0c1f1905222f9c7f7baf2225ea7d85beefdf49050: Status 404 returned error can't find the container with id 52cb26d250d231d999cf8ca0c1f1905222f9c7f7baf2225ea7d85beefdf49050
Oct 30 19:40:20.097528 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:20.097449    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:20.664676 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:20.664644    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v" event={"ID":"3e8dca38-1009-42b6-b5e4-e635ba755eaa","Type":"ContainerStarted","Data":"5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006"}
Oct 30 19:40:20.664888 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:20.664697    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v" event={"ID":"3e8dca38-1009-42b6-b5e4-e635ba755eaa","Type":"ContainerStarted","Data":"52cb26d250d231d999cf8ca0c1f1905222f9c7f7baf2225ea7d85beefdf49050"}
Oct 30 19:40:20.664888 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:20.664836    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 19:40:20.785784 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:20.785721    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v" podStartSLOduration=2.7857004610000002 podStartE2EDuration="2.785700461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:40:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:40:20.785239294 +0000 UTC m=+883.328046562" watchObservedRunningTime="2026-10-30 19:40:20.785700461 +0000 UTC m=+883.328507727"
Oct 30 19:40:22.722188 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:22.722152    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:22.960987 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:22.960959    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:23.592466 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:23.592431    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:23.753017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:23.752967    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:24.924333 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:24.924299    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"]
Oct 30 19:40:24.931905 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:24.931867    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.029351 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.029308    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-bbfa07-serving-cert\""
Oct 30 19:40:25.031067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.031045    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"]
Oct 30 19:40:25.096593 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.096500    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx2lr\" (UniqueName: \"kubernetes.io/projected/e3ba1452-be29-49f4-923f-a535693624fe-kube-api-access-sx2lr\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.096593 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.096566    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-maas-api-tls\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.096768 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.096729    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-metrics-certs\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.096768 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.096757    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ba1452-be29-49f4-923f-a535693624fe-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.122592 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.122553    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:25.197589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.197552    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-metrics-certs\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.197589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.197592    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ba1452-be29-49f4-923f-a535693624fe-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.197905 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.197647    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx2lr\" (UniqueName: \"kubernetes.io/projected/e3ba1452-be29-49f4-923f-a535693624fe-kube-api-access-sx2lr\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.197905 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.197671    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-maas-api-tls\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.198617 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.198585    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ba1452-be29-49f4-923f-a535693624fe-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.200491 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.200460    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-maas-api-tls\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.200491 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.200479    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-metrics-certs\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.256949 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.256913    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx2lr\" (UniqueName: \"kubernetes.io/projected/e3ba1452-be29-49f4-923f-a535693624fe-kube-api-access-sx2lr\") pod \"maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.323120 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.323088    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:25.546765 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.546735    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:25.937941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:25.937678    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"]
Oct 30 19:40:25.941147 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:40:25.941122    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ba1452_be29_49f4_923f_a535693624fe.slice/crio-eb5e72951a13bed0ff37f0415dff3da1046ec6caac3af37d50dbd90b40466892 WatchSource:0}: Error finding container eb5e72951a13bed0ff37f0415dff3da1046ec6caac3af37d50dbd90b40466892: Status 404 returned error can't find the container with id eb5e72951a13bed0ff37f0415dff3da1046ec6caac3af37d50dbd90b40466892
Oct 30 19:40:26.727209 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:26.727168    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj" event={"ID":"e3ba1452-be29-49f4-923f-a535693624fe","Type":"ContainerStarted","Data":"eb5e72951a13bed0ff37f0415dff3da1046ec6caac3af37d50dbd90b40466892"}
Oct 30 19:40:27.735369 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:27.735329    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj" event={"ID":"e3ba1452-be29-49f4-923f-a535693624fe","Type":"ContainerStarted","Data":"b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea"}
Oct 30 19:40:27.735968 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:27.735397    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:27.849504 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:27.849441    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj" podStartSLOduration=3.048418356 podStartE2EDuration="3.849424459s" totalImagesPullingTime="801.006103ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:40:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:40:27.847686136 +0000 UTC m=+890.390493404" watchObservedRunningTime="2026-10-30 19:40:27.849424459 +0000 UTC m=+890.392231724"
Oct 30 19:40:28.218122 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:40:28.218086    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:40:28.743630 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:28.743597    6015 generic.go:356] "Generic (PLEG): container finished" podID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerID="4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27" exitCode=0
Oct 30 19:40:28.744085 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:28.743671    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" event={"ID":"a1e325c6-3061-4f98-80e8-3d95a9c2896c","Type":"ContainerDied","Data":"4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27"}
Oct 30 19:40:28.744273 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:28.744254    6015 scope.go:122] "RemoveContainer" containerID="4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27"
Oct 30 19:40:28.745478 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:28.745446    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:40:28.745589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:28.745531    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:40:28.745589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:28.745579    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:40:29.751250 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:29.751212    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" event={"ID":"a1e325c6-3061-4f98-80e8-3d95a9c2896c","Type":"ContainerStarted","Data":"745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc"}
Oct 30 19:40:30.154163 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:30.154126    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:40:30.155427 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:30.155406    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Oct 30 19:40:30.155484 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:30.155456    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Oct 30 19:40:30.241521 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:30.241487    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:31.154695 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:31.154657    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Oct 30 19:40:31.155246 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:31.154711    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Oct 30 19:40:31.696860 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:31.696831    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 19:40:32.154402 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:32.154366    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Oct 30 19:40:32.154589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:32.154421    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Oct 30 19:40:32.472907 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:32.470919    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:40:33.154171 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:33.154136    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Oct 30 19:40:33.154362 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:33.154190    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Oct 30 19:40:33.749310 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:33.749285    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 19:40:34.154457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:34.154417    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Oct 30 19:40:34.154645 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:34.154475    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Oct 30 19:40:35.119347 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:35.119305    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:35.166818 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:35.166771    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:40:35.170711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:35.170681    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 19:40:35.328400 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:35.328358    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:35.481581 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:35.481488    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:40.003427 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:40.003392    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:40.207588 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:40.207542    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:40.660416 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:40.660375    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:40.816291 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:40.816257    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:41.379933 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:41.379901    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:43.566002 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:43.565959    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:44.969744 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:44.969706    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:45.917191 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:45.917095    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"]
Oct 30 19:40:45.921279 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:45.921252    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:45.970892 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:45.970864    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-bbfa07-openshift-default-dockercfg-vj7kd\""
Oct 30 19:40:46.019260 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.019226    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"]
Oct 30 19:40:46.041374 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.041337    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.041578 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.041415    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-credential-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.041578 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.041520    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-token\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.041578 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.041562    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-envoy\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.041746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.041619    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52fp2\" (UniqueName: \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-kube-api-access-52fp2\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.041746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.041732    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istiod-ca-cert\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.041881 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.041860    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-data\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.041936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.041897    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-certs\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.041986 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.041953    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-podinfo\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.142986 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.142952    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.143183 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.143029    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-credential-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.143183 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.143055    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-token\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.143183 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.143094    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-envoy\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.143183 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.143118    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52fp2\" (UniqueName: \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-kube-api-access-52fp2\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.144469 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.144442    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istiod-ca-cert\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.144639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.143408    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.144639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.144363    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-credential-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.145407 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.145379    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istiod-ca-cert\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.145678 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.145654    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-data\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.145796 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.145695    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-certs\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.145796 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.145762    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-podinfo\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.146145 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.146123    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-certs\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.146449 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.146397    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-data\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.146795 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.146756    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-envoy\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.150429 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.150404    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-podinfo\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.202612 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.202529    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52fp2\" (UniqueName: \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-kube-api-access-52fp2\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.203202 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.203175    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-token\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.234140 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.234109    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:46.375399 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.375349    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:46.655534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.655504    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"]
Oct 30 19:40:46.690841 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:40:46.690792    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e26bd4_2c07_49cf_b1a2_6773058e7a83.slice/crio-6aec53d89da3e43492976e0194abb13374c4f087d51d8ddf6d1d843721e6492b WatchSource:0}: Error finding container 6aec53d89da3e43492976e0194abb13374c4f087d51d8ddf6d1d843721e6492b: Status 404 returned error can't find the container with id 6aec53d89da3e43492976e0194abb13374c4f087d51d8ddf6d1d843721e6492b
Oct 30 19:40:46.693415 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.693381    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:40:46.693536 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.693460    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:40:46.693536 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.693510    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:40:46.875488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.875438    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" event={"ID":"75e26bd4-2c07-49cf-b1a2-6773058e7a83","Type":"ContainerStarted","Data":"88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff"}
Oct 30 19:40:46.875704 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.875503    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" event={"ID":"75e26bd4-2c07-49cf-b1a2-6773058e7a83","Type":"ContainerStarted","Data":"6aec53d89da3e43492976e0194abb13374c4f087d51d8ddf6d1d843721e6492b"}
Oct 30 19:40:46.991077 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:46.990964    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" podStartSLOduration=1.990949624 podStartE2EDuration="1.990949624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:40:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:40:46.989770471 +0000 UTC m=+909.532577735" watchObservedRunningTime="2026-10-30 19:40:46.990949624 +0000 UTC m=+909.533756889"
Oct 30 19:40:47.235319 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:47.235279    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:47.236864 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:47.236797    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 19:40:47.237016 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:47.236885    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" podUID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 19:40:48.235338 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:48.235305    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 19:40:48.235763 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:48.235360    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" podUID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 19:40:49.234989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:49.234951    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 19:40:49.235207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:49.235006    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" podUID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 19:40:49.691012 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:49.690979    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:49.885833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:49.883905    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:50.234889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:50.234856    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 19:40:50.235056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:50.234918    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" podUID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 19:40:51.234971 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:51.234935    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 19:40:51.235360 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:51.234990    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" podUID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 19:40:52.235305 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:52.235263    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Oct 30 19:40:52.235735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:52.235358    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" podUID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Oct 30 19:40:53.238886 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:53.238857    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:53.239284 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:53.239255    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:53.240008 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:53.239989    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:40:54.353111 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:54.353074    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:40:58.216588 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:40:58.216545    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:40:58.950518 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:40:58.950483    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:00.446006 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:00.445971    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:01.044467 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:01.044435    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:01.264314 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:01.264283    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:03.860629 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:03.860583    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:08.461363 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:08.461324    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:12.752013 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:12.751977    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:13.244786 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:13.244744    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:13.611764 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:13.611728    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:13.799552 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:13.799510    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:16.167537 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.167501    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"]
Oct 30 19:41:16.170786 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.170768    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.214291 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.214249    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"]
Oct 30 19:41:16.217275 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.217257    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.268620 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.268585    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"]
Oct 30 19:41:16.298905 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.298869    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.299163 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299143    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-data\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.299314 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299290    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-data\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.299665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299323    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-envoy\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.299665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299349    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-token\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.299665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299383    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-podinfo\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.299665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299421    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-podinfo\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.299665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299456    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istiod-ca-cert\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.299665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299484    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-token\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.299665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299532    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.299665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299569    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-certs\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.299665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299627    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-certs\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.299665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299659    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf05960d-4801-4d8f-9479-7110f0266b2f-istiod-ca-cert\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.300055 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299686    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-envoy\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.300055 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299717    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7szwv\" (UniqueName: \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-kube-api-access-7szwv\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.300055 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299799    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-credential-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.300055 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299858    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-credential-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.300055 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.299893    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl49j\" (UniqueName: \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-kube-api-access-dl49j\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.318012 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.317974    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"]
Oct 30 19:41:16.401327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401295    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.401327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401332    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-data\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.401568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401376    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-data\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.401568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401399    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-envoy\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.401568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401424    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-token\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.401568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401457    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-podinfo\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.401568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401491    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-podinfo\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.401568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401520    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istiod-ca-cert\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.401568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401546    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-token\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.402035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401594    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.402035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401629    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-certs\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.402035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401680    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-certs\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.402035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401710    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf05960d-4801-4d8f-9479-7110f0266b2f-istiod-ca-cert\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.402035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401742    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-envoy\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.402035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401764    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.402035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401774    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7szwv\" (UniqueName: \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-kube-api-access-7szwv\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.402035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401843    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-data\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.402035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.401865    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-data\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.402589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.402171    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-credential-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.402589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.402213    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-credential-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.402589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.402261    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl49j\" (UniqueName: \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-kube-api-access-dl49j\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.402589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.402450    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.402853 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.402690    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-certs\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.402925 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.402863    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-credential-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.402984 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.402941    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istiod-ca-cert\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.403044 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.402989    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-certs\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.403164 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.403127    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-credential-socket\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.403602 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.403567    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf05960d-4801-4d8f-9479-7110f0266b2f-istiod-ca-cert\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.406072 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.406045    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-envoy\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.406388 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.406362    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-podinfo\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.406863 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.406794    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-envoy\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.408322 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.408299    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-podinfo\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.460772 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.460692    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-token\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.460961 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.460798    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl49j\" (UniqueName: \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-kube-api-access-dl49j\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.461062 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.461037    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7szwv\" (UniqueName: \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-kube-api-access-7szwv\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.461227 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.461209    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-token\") pod \"e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") " pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.484280 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.484250    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:16.530204 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.529947    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:16.908379 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.908335    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"]
Oct 30 19:41:16.942693 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:41:16.942658    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf05960d_4801_4d8f_9479_7110f0266b2f.slice/crio-8e858b4a49c2e6e49b8025200ff2d176a0b86f6e19dc66b44154614dfaa7bedc WatchSource:0}: Error finding container 8e858b4a49c2e6e49b8025200ff2d176a0b86f6e19dc66b44154614dfaa7bedc: Status 404 returned error can't find the container with id 8e858b4a49c2e6e49b8025200ff2d176a0b86f6e19dc66b44154614dfaa7bedc
Oct 30 19:41:16.944993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.944959    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:41:16.945082 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.945034    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:41:16.945082 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.945065    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:41:16.958191 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.958167    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"]
Oct 30 19:41:16.961294 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:41:16.961265    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ceebb6_a0c0_4b43_8261_6bb6144d754b.slice/crio-e1e7af0946f30ad554dfdcf13cb92e4ffb41bf5b5609a6cbbfa96f56079ad1f7 WatchSource:0}: Error finding container e1e7af0946f30ad554dfdcf13cb92e4ffb41bf5b5609a6cbbfa96f56079ad1f7: Status 404 returned error can't find the container with id e1e7af0946f30ad554dfdcf13cb92e4ffb41bf5b5609a6cbbfa96f56079ad1f7
Oct 30 19:41:16.963989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.963947    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:41:16.964096 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.964043    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:41:16.964096 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:16.964088    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:41:17.055471 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:17.055432    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" event={"ID":"d1ceebb6-a0c0-4b43-8261-6bb6144d754b","Type":"ContainerStarted","Data":"0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d"}
Oct 30 19:41:17.055658 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:17.055500    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" event={"ID":"d1ceebb6-a0c0-4b43-8261-6bb6144d754b","Type":"ContainerStarted","Data":"e1e7af0946f30ad554dfdcf13cb92e4ffb41bf5b5609a6cbbfa96f56079ad1f7"}
Oct 30 19:41:17.061845 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:17.057885    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4" event={"ID":"cf05960d-4801-4d8f-9479-7110f0266b2f","Type":"ContainerStarted","Data":"ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a"}
Oct 30 19:41:17.061845 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:17.057943    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4" event={"ID":"cf05960d-4801-4d8f-9479-7110f0266b2f","Type":"ContainerStarted","Data":"8e858b4a49c2e6e49b8025200ff2d176a0b86f6e19dc66b44154614dfaa7bedc"}
Oct 30 19:41:17.172357 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:17.172222    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" podStartSLOduration=1.172189218 podStartE2EDuration="1.172189218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:41:17.170249806 +0000 UTC m=+939.713057069" watchObservedRunningTime="2026-10-30 19:41:17.172189218 +0000 UTC m=+939.714996484"
Oct 30 19:41:17.287669 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:17.287604    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4" podStartSLOduration=1.287580457 podStartE2EDuration="1.287580457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:41:17.285278885 +0000 UTC m=+939.828086150" watchObservedRunningTime="2026-10-30 19:41:17.287580457 +0000 UTC m=+939.830387723"
Oct 30 19:41:17.488893 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:17.485915    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:17.530087 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:17.530047    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:18.125849 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:18.122485    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:18.491889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:18.490941    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Oct 30 19:41:18.491889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:18.491016    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4" podUID="cf05960d-4801-4d8f-9479-7110f0266b2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Oct 30 19:41:18.532326 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:18.532289    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Oct 30 19:41:18.532504 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:18.532352    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" podUID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Oct 30 19:41:19.487243 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:19.487206    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Oct 30 19:41:19.487626 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:19.487584    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4" podUID="cf05960d-4801-4d8f-9479-7110f0266b2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Oct 30 19:41:19.530649 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:19.530612    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Oct 30 19:41:19.531283 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:19.531251    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" podUID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Oct 30 19:41:20.485836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:20.485300    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Oct 30 19:41:20.485836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:20.485379    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4" podUID="cf05960d-4801-4d8f-9479-7110f0266b2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Oct 30 19:41:20.530589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:20.530552    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Oct 30 19:41:20.530763 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:20.530632    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" podUID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Oct 30 19:41:21.037496 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:21.037394    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:21.490834 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:21.489276    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Oct 30 19:41:21.490834 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:21.489346    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4" podUID="cf05960d-4801-4d8f-9479-7110f0266b2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Oct 30 19:41:21.530501 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:21.530464    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Oct 30 19:41:21.530690 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:21.530531    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" podUID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Oct 30 19:41:22.487834 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:22.487221    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Oct 30 19:41:22.487834 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:22.487291    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4" podUID="cf05960d-4801-4d8f-9479-7110f0266b2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Oct 30 19:41:22.530371 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:22.530336    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Oct 30 19:41:22.530566 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:22.530395    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" podUID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Oct 30 19:41:22.882832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:22.882393    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:23.489952 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:23.489913    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:23.490386 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:23.490329    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:23.491256 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:23.491235    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 19:41:23.534985 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:23.534945    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:23.535263 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:23.535242    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:23.536184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:23.536162    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 19:41:27.487523 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:27.487484    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:28.216735 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:41:28.216695    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:41:32.068072 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:32.068033    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:36.661898 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:36.661863    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:41.502155 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:41.502118    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:41.826712 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:41.826681    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:43.880341 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:43.880306    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:46.171078 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:46.171040    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:50.472275 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:50.472233    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:50.768211 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:50.768108    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:55.547010 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:55.546978    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:58.195150 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.195113    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"]
Oct 30 19:41:58.199626 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.199598    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.223559 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:41:58.223511    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:41:58.232933 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.232904    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tmp-dir\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.233121 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.233018    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-home\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.233121 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.233116    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-model-cache\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.233240 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.233184    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qxl7\" (UniqueName: \"kubernetes.io/projected/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-kube-api-access-4qxl7\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.233296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.233243    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tls-certs\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.233359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.233323    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-dshm\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.284545 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.284505    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:41:58.292919 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.292887    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"]
Oct 30 19:41:58.300396 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.300362    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b0a183\"/\"kube-root-ca.crt\""
Oct 30 19:41:58.300549 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.300417    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b0a183\"/\"openshift-service-ca.crt\""
Oct 30 19:41:58.300549 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.300439    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b0a183\"/\"premium-w2-b0a183-kserve-self-signed-certs\""
Oct 30 19:41:58.300549 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.300493    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b0a183\"/\"default-dockercfg-xjrrw\""
Oct 30 19:41:58.334431 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.334400    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tls-certs\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.334661 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.334458    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-dshm\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.334661 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.334514    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tmp-dir\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.334661 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.334650    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-home\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.334996 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.334764    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-model-cache\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.334996 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.334792    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qxl7\" (UniqueName: \"kubernetes.io/projected/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-kube-api-access-4qxl7\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.335768 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.335729    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-home\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.336007 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.335985    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-model-cache\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.336203 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.336180    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tmp-dir\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.342863 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.342793    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-dshm\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.343752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.343714    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tls-certs\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.393752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.393721    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qxl7\" (UniqueName: \"kubernetes.io/projected/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-kube-api-access-4qxl7\") pod \"premium-w2-b0a183-kserve-6f79977f5-9f8z6\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") " pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.515376 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.515285    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:41:58.909067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:58.909033    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"]
Oct 30 19:41:58.913502 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:41:58.913473    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69e9c36e_d8c7_4efa_88da_1b962ce16ddb.slice/crio-9491ee881268c2ac53199782ce719fa42487c542a176648e23deed7e047e8720 WatchSource:0}: Error finding container 9491ee881268c2ac53199782ce719fa42487c542a176648e23deed7e047e8720: Status 404 returned error can't find the container with id 9491ee881268c2ac53199782ce719fa42487c542a176648e23deed7e047e8720
Oct 30 19:41:59.327675 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:59.327637    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" event={"ID":"69e9c36e-d8c7-4efa-88da-1b962ce16ddb","Type":"ContainerStarted","Data":"103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965"}
Oct 30 19:41:59.327675 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:59.327680    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" event={"ID":"69e9c36e-d8c7-4efa-88da-1b962ce16ddb","Type":"ContainerStarted","Data":"9491ee881268c2ac53199782ce719fa42487c542a176648e23deed7e047e8720"}
Oct 30 19:41:59.440211 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:59.440158    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" podStartSLOduration=1.440143977 podStartE2EDuration="1.440143977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:41:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:41:59.438578935 +0000 UTC m=+981.981386230" watchObservedRunningTime="2026-10-30 19:41:59.440143977 +0000 UTC m=+981.982951241"
Oct 30 19:41:59.516286 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:41:59.516247    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:42:00.168083 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:00.168045    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:04.840669 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:04.840633    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:08.515969 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:08.515929    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:42:08.528600 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:08.528569    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:42:09.405507 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:09.405473    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:42:09.450333 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:09.450301    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:14.091114 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:14.091077    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:18.758590 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:18.758499    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:21.356162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:21.356117    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:23.474467 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:23.474429    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:28.066337 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:28.066301    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:28.216010 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:42:28.215974    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:42:32.611945 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:32.611903    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:37.285959 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:37.285919    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:41.946857 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:41.946791    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:43.816124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.816088    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"]
Oct 30 19:42:43.820695 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.820667    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:43.870514 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.870477    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-98a19b\"/\"default-dockercfg-hntn4\""
Oct 30 19:42:43.898268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.898235    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-model-cache\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:43.898454 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.898378    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444d7fc5-1339-416f-b734-585f2c7ddb04-tls-certs\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:43.898454 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.898421    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-dshm\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:43.898544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.898460    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hvdw\" (UniqueName: \"kubernetes.io/projected/444d7fc5-1339-416f-b734-585f2c7ddb04-kube-api-access-8hvdw\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:43.898544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.898506    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-home\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:43.898640 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.898615    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-tmp-dir\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:43.902659 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.902625    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:43.917462 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.917437    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-98a19b\"/\"openshift-service-ca.crt\""
Oct 30 19:42:43.917462 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.917445    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-98a19b\"/\"kube-root-ca.crt\""
Oct 30 19:42:43.919662 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.919638    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"]
Oct 30 19:42:43.971338 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.971269    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-98a19b\"/\"premium-w1-98a19b-kserve-self-signed-certs\""
Oct 30 19:42:43.999708 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.999676    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-model-cache\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:43.999927 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.999741    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444d7fc5-1339-416f-b734-585f2c7ddb04-tls-certs\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:43.999927 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.999777    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-dshm\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:43.999927 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.999834    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hvdw\" (UniqueName: \"kubernetes.io/projected/444d7fc5-1339-416f-b734-585f2c7ddb04-kube-api-access-8hvdw\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:43.999927 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.999870    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-home\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:44.000164 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:43.999933    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-tmp-dir\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:44.000220 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.000179    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-model-cache\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:44.000485 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.000460    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-home\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:44.000582 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.000546    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-tmp-dir\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:44.002496 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.002473    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-dshm\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:44.002798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.002778    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444d7fc5-1339-416f-b734-585f2c7ddb04-tls-certs\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:44.058543 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.058511    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hvdw\" (UniqueName: \"kubernetes.io/projected/444d7fc5-1339-416f-b734-585f2c7ddb04-kube-api-access-8hvdw\") pod \"premium-w1-98a19b-kserve-78d4d988f7-2t8vc\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") " pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:44.133324 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.133221    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:44.217775 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.217742    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:44.380113 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.380078    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:44.527529 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.527503    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"]
Oct 30 19:42:44.530392 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:42:44.530366    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod444d7fc5_1339_416f_b734_585f2c7ddb04.slice/crio-21c2d8f44a51a3f9463b71bf7ba0b92e7b7381e32ded950de159430d04ec1292 WatchSource:0}: Error finding container 21c2d8f44a51a3f9463b71bf7ba0b92e7b7381e32ded950de159430d04ec1292: Status 404 returned error can't find the container with id 21c2d8f44a51a3f9463b71bf7ba0b92e7b7381e32ded950de159430d04ec1292
Oct 30 19:42:44.622958 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.622926    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" event={"ID":"444d7fc5-1339-416f-b734-585f2c7ddb04","Type":"ContainerStarted","Data":"d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784"}
Oct 30 19:42:44.623140 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.622975    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" event={"ID":"444d7fc5-1339-416f-b734-585f2c7ddb04","Type":"ContainerStarted","Data":"21c2d8f44a51a3f9463b71bf7ba0b92e7b7381e32ded950de159430d04ec1292"}
Oct 30 19:42:44.741002 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:44.740937    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" podStartSLOduration=1.740922812 podStartE2EDuration="1.740922812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:42:44.739443299 +0000 UTC m=+1027.282250565" watchObservedRunningTime="2026-10-30 19:42:44.740922812 +0000 UTC m=+1027.283730076"
Oct 30 19:42:45.133596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:45.133559    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:46.534551 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:46.534515    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:51.150073 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:51.150035    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:54.134281 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:54.134242    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:54.147670 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:54.147634    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:54.689597 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:54.689567    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:42:55.787239 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:42:55.787192    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:42:58.215851 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:42:58.215794    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:43:00.365757 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:00.365726    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:04.976270 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:04.976235    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:09.569361 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:09.569322    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:12.348204 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:12.348159    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:12.549193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:12.549156    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:14.165747 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:14.165712    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:18.758943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:18.758899    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:23.374851 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:23.374797    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:27.972609 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:27.972573    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:28.216555 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:43:28.216508    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:43:31.522745 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:31.522707    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:31.680209 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:31.680155    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:31.838851 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:31.838822    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:32.590221 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:32.590180    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:33.820395 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.820357    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"]
Oct 30 19:43:33.824674 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.824651    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.872510 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.872467    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.872674 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.872523    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7f4f0cb-ae81-4f27-9799-0513b638968e-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.872674 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.872601    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.872769 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.872753    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zsts\" (UniqueName: \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-kube-api-access-5zsts\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.872847 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.872787    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.872894 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.872863    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.872894 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.872885    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.872989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.872974    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.873023 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.873008    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.874608 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.874592    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-98a19b-openshift-default-dockercfg-rhphv\""
Oct 30 19:43:33.927018 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.926981    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"]
Oct 30 19:43:33.973756 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.973723    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zsts\" (UniqueName: \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-kube-api-access-5zsts\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.973947 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.973765    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.973947 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.973797    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.973947 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.973838    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.973947 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.973886    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.973947 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.973915    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.973947 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.973942    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.974249 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.973974    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7f4f0cb-ae81-4f27-9799-0513b638968e-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.974249 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.974027    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.974371 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.974311    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.974371 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.974347    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.974480 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.974382    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.974480 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.974424    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.974735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.974715    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7f4f0cb-ae81-4f27-9799-0513b638968e-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.976439 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.976416    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:33.976656 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:33.976638    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:34.034822 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:34.034768    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zsts\" (UniqueName: \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-kube-api-access-5zsts\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:34.050596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:34.050559    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:34.139407 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:34.139320    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:34.572446 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:34.572415    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"]
Oct 30 19:43:34.574628 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:43:34.574602    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f4f0cb_ae81_4f27_9799_0513b638968e.slice/crio-4918e4207575762f5fec51c0b22f25e0bb02c7e27eaa2238304b7aa934ac089b WatchSource:0}: Error finding container 4918e4207575762f5fec51c0b22f25e0bb02c7e27eaa2238304b7aa934ac089b: Status 404 returned error can't find the container with id 4918e4207575762f5fec51c0b22f25e0bb02c7e27eaa2238304b7aa934ac089b
Oct 30 19:43:34.577965 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:34.577924    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:43:34.578046 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:34.578019    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:43:34.578084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:34.578067    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:43:34.942849 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:34.942752    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" event={"ID":"c7f4f0cb-ae81-4f27-9799-0513b638968e","Type":"ContainerStarted","Data":"5cfa7b66af1aeacb4f146755d05fe2a73e672e28d24888fe0cbf6396d5144f70"}
Oct 30 19:43:34.943243 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:34.942847    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" event={"ID":"c7f4f0cb-ae81-4f27-9799-0513b638968e","Type":"ContainerStarted","Data":"4918e4207575762f5fec51c0b22f25e0bb02c7e27eaa2238304b7aa934ac089b"}
Oct 30 19:43:35.139961 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:35.139921    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:35.141711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:35.141691    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 19:43:35.141835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:35.141742    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 19:43:35.935702 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:35.935662    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:36.140020 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:36.139983    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 19:43:36.140425 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:36.140037    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 19:43:37.140037 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:37.140001    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 19:43:37.140423 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:37.140064    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 19:43:37.285929 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:37.285798    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:38.140307 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:38.140270    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 19:43:38.140730 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:38.140389    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 19:43:39.140451 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:39.140414    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 19:43:39.140888 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:39.140470    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 19:43:40.140180 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:40.140141    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 19:43:40.140379 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:40.140202    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 19:43:41.298157 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:41.298122    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:41.299340 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:41.299297    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:41.300801 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:41.300779    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 19:43:41.462527 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:41.462474    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" podStartSLOduration=8.462458087 podStartE2EDuration="8.462458087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:43:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:43:35.063106534 +0000 UTC m=+1077.605913799" watchObservedRunningTime="2026-10-30 19:43:41.462458087 +0000 UTC m=+1084.005265353"
Oct 30 19:43:41.860600 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:41.860562    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:44.561769 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:44.561728    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:46.468475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:46.468376    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:51.336680 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:51.336639    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:55.615153 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.615115    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:55.780097 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.780062    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"]
Oct 30 19:43:55.784289 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.784271    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.871724 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.871627    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-routing-overlay-volume\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.872150 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.872105    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7lrk\" (UniqueName: \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-kube-api-access-r7lrk\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.872367 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.872334    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-plugins-config-volume\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.872500 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.872380    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-provider-credentials\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.882565 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.882522    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-449cc5558c4a\""
Oct 30 19:43:55.882565 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.882556    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-dockercfg-qvs4q\""
Oct 30 19:43:55.882871 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.882632    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"openshift-service-ca.crt\""
Oct 30 19:43:55.882871 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.882638    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-plugins\""
Oct 30 19:43:55.887371 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.884325    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"kube-root-ca.crt\""
Oct 30 19:43:55.887597 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.884405    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"routing-overlay\""
Oct 30 19:43:55.887597 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.885340    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"]
Oct 30 19:43:55.973311 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.973279    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-routing-overlay-volume\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.973514 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.973319    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7lrk\" (UniqueName: \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-kube-api-access-r7lrk\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.973514 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.973358    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-plugins-config-volume\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.973514 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.973388    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-provider-credentials\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.974012 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.973984    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-routing-overlay-volume\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.974143 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.974119    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-plugins-config-volume\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.976385 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.976308    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-provider-credentials\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:55.978006 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:55.977973    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:43:56.033200 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:56.033167    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7lrk\" (UniqueName: \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-kube-api-access-r7lrk\") pod \"payload-processing-external-model-5dc946644f-sxthh\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") " pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:56.098639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:56.098601    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:56.473286 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:56.473262    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"]
Oct 30 19:43:56.475605 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:43:56.475576    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3601725e_928e_437a_a8e2_d142ef2b70de.slice/crio-1b564d1508d5234c8b0ad4275d92f425a8564592edfe5a853b8f69c039b90e74 WatchSource:0}: Error finding container 1b564d1508d5234c8b0ad4275d92f425a8564592edfe5a853b8f69c039b90e74: Status 404 returned error can't find the container with id 1b564d1508d5234c8b0ad4275d92f425a8564592edfe5a853b8f69c039b90e74
Oct 30 19:43:57.097870 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:57.097828    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" event={"ID":"3601725e-928e-437a-a8e2-d142ef2b70de","Type":"ContainerStarted","Data":"2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61"}
Oct 30 19:43:57.098414 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:57.097890    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" event={"ID":"3601725e-928e-437a-a8e2-d142ef2b70de","Type":"ContainerStarted","Data":"1b564d1508d5234c8b0ad4275d92f425a8564592edfe5a853b8f69c039b90e74"}
Oct 30 19:43:57.098414 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:57.098010    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:43:57.212532 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:43:57.212476    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podStartSLOduration=2.212461015 podStartE2EDuration="2.212461015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:43:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:43:57.211236663 +0000 UTC m=+1099.754043929" watchObservedRunningTime="2026-10-30 19:43:57.212461015 +0000 UTC m=+1099.755268281"
Oct 30 19:43:58.216218 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:43:58.216178    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:44:00.559478 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:00.559441    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:05.199365 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:05.199322    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:08.107059 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:08.107024    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:44:09.769775 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:09.769736    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:14.372339 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:14.372291    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:18.105676 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:18.105637    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:44:18.959704 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:18.959667    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:19.278576 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.278486    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"]
Oct 30 19:44:19.284471 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.284442    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.325253 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.325216    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"]
Oct 30 19:44:19.329265 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.329239    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.375408 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.375364    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.375679 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.375656    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsvj8\" (UniqueName: \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-kube-api-access-bsvj8\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.375851 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.375796    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5kzz\" (UniqueName: \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-kube-api-access-r5kzz\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.375993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.375886    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f089f140-7168-4c4c-a816-6c864dae4a63-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.375993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.375922    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.376117 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376058    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.376174 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376127    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.376174 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376154    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ab8f161-e5ca-4218-917c-8fb515ef3099-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.376279 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376219    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f089f140-7168-4c4c-a816-6c864dae4a63-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.376279 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376254    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.376386 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376292    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.376386 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376341    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.376386 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376376    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.376531 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376500    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.376710 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376687    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.376799 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376776    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.376952 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376832    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.376952 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.376906    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.378469 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.378445    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"]
Oct 30 19:44:19.445259 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.445220    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"]
Oct 30 19:44:19.477944 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.477909    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5kzz\" (UniqueName: \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-kube-api-access-r5kzz\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.478160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.477961    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f089f140-7168-4c4c-a816-6c864dae4a63-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.478160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.477986    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.478160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478007    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.478160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478025    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.478160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478040    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ab8f161-e5ca-4218-917c-8fb515ef3099-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.478160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478085    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f089f140-7168-4c4c-a816-6c864dae4a63-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.478160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478120    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.478160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478152    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.478604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478196    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.478604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478228    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.478604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478258    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.478604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478322    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.478604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478393    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.478604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478417    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.478604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478450    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.478604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478509    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.478604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478521    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.478604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478535    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsvj8\" (UniqueName: \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-kube-api-access-bsvj8\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.478604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478576    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.479235 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478655    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.479235 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478879    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.479235 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478883    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.479235 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478925    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ab8f161-e5ca-4218-917c-8fb515ef3099-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.479235 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478937    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f089f140-7168-4c4c-a816-6c864dae4a63-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.479235 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.478942    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.479235 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.479148    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.479559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.479402    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.481206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.481183    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.481306 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.481203    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.481894 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.481866    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f089f140-7168-4c4c-a816-6c864dae4a63-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.482005 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.481875    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.539672 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.539579    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.539672 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.539610    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.539970 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.539924    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5kzz\" (UniqueName: \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-kube-api-access-r5kzz\") pod \"maas-default-gateway-openshift-default-694db55c87-859kr\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:19.540062 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.540042    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsvj8\" (UniqueName: \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-kube-api-access-bsvj8\") pod \"maas-default-gateway-openshift-default-694db55c87-5mm4g\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.598923 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.598884    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:19.645443 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:19.645407    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:20.027813 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.027759    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"]
Oct 30 19:44:20.062853 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:44:20.062768    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf089f140_7168_4c4c_a816_6c864dae4a63.slice/crio-ca505a8783bd69ffd0026f4d03956ec609c371ff7ac77d682b0f87fec401718c WatchSource:0}: Error finding container ca505a8783bd69ffd0026f4d03956ec609c371ff7ac77d682b0f87fec401718c: Status 404 returned error can't find the container with id ca505a8783bd69ffd0026f4d03956ec609c371ff7ac77d682b0f87fec401718c
Oct 30 19:44:20.065563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.065527    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:44:20.065669 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.065615    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:44:20.065669 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.065660    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:44:20.082866 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.082840    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"]
Oct 30 19:44:20.087056 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:44:20.087029    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab8f161_e5ca_4218_917c_8fb515ef3099.slice/crio-5b723ef94fdc6c20af94811860f83ff13dc050594af363d7a86cc9740dd6c641 WatchSource:0}: Error finding container 5b723ef94fdc6c20af94811860f83ff13dc050594af363d7a86cc9740dd6c641: Status 404 returned error can't find the container with id 5b723ef94fdc6c20af94811860f83ff13dc050594af363d7a86cc9740dd6c641
Oct 30 19:44:20.089138 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.089107    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:44:20.089215 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.089175    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:44:20.089215 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.089203    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:44:20.294424 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.294385    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" event={"ID":"f089f140-7168-4c4c-a816-6c864dae4a63","Type":"ContainerStarted","Data":"054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88"}
Oct 30 19:44:20.294942 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.294458    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" event={"ID":"f089f140-7168-4c4c-a816-6c864dae4a63","Type":"ContainerStarted","Data":"ca505a8783bd69ffd0026f4d03956ec609c371ff7ac77d682b0f87fec401718c"}
Oct 30 19:44:20.296373 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.296346    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" event={"ID":"1ab8f161-e5ca-4218-917c-8fb515ef3099","Type":"ContainerStarted","Data":"56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8"}
Oct 30 19:44:20.296497 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.296398    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" event={"ID":"1ab8f161-e5ca-4218-917c-8fb515ef3099","Type":"ContainerStarted","Data":"5b723ef94fdc6c20af94811860f83ff13dc050594af363d7a86cc9740dd6c641"}
Oct 30 19:44:20.411387 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.411324    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" podStartSLOduration=1.411304889 podStartE2EDuration="1.411304889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:44:20.408909352 +0000 UTC m=+1122.951716645" watchObservedRunningTime="2026-10-30 19:44:20.411304889 +0000 UTC m=+1122.954112156"
Oct 30 19:44:20.528625 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.528562    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" podStartSLOduration=1.528542083 podStartE2EDuration="1.528542083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:44:20.525486172 +0000 UTC m=+1123.068293437" watchObservedRunningTime="2026-10-30 19:44:20.528542083 +0000 UTC m=+1123.071349350"
Oct 30 19:44:20.599863 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.599745    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:20.653832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:20.649915    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:21.611853 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:21.611782    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mm4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 19:44:21.612745 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:21.612415    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 19:44:21.648079 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:21.648045    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-859kr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 19:44:21.648258 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:21.648100    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 19:44:22.603830 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:22.603225    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mm4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 19:44:22.603830 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:22.603288    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 19:44:22.646526 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:22.646494    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-859kr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 19:44:22.646936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:22.646548    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 19:44:23.593829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:23.593513    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:23.613838 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:23.609452    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mm4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 19:44:23.613838 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:23.609510    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 19:44:23.646898 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:23.646853    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-859kr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 19:44:23.647429 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:23.646938    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 19:44:24.605832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:24.601320    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mm4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 19:44:24.605832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:24.601386    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 19:44:24.646316 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:24.646268    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-859kr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 19:44:24.646474 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:24.646332    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 19:44:25.621835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:25.618824    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mm4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 19:44:25.621835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:25.618975    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 19:44:25.645885 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:25.645842    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-859kr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 19:44:25.646055 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:25.645913    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 19:44:26.236433 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:26.236390    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:26.599848 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:26.599779    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mm4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 19:44:26.600032 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:26.599875    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 19:44:26.646209 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:26.646171    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-859kr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 19:44:26.646639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:26.646238    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 19:44:27.600078 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:27.600036    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mm4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 30 19:44:27.600293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:27.600111    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 30 19:44:27.646598 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:27.646556    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-859kr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 30 19:44:27.647005 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:27.646625    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 30 19:44:28.105329 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:28.105286    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:44:28.180504 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:28.180460    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:28.230459 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:44:28.230416    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:44:28.762616 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:28.762581    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:28.763868 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:28.763848    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:28.764759 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:28.764735    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 19:44:28.839444 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:28.839411    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:28.840204 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:28.840170    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:28.841468 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:28.841445    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:44:32.767873 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:32.767827    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:37.546862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:37.546822    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:38.105476 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:38.105439    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:44:38.232693 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:38.232650    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:39.381714 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.381677    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"]
Oct 30 19:44:39.387134 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.387112    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.482095 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.482058    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:39.486265 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.486243    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-98a19b\"/\"distinct-w1-98a19b-kserve-self-signed-certs\""
Oct 30 19:44:39.488950 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.488929    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"]
Oct 30 19:44:39.492851 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.492831    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-home\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.492932 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.492870    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-dshm\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.492932 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.492895    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-model-cache\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.493022 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.493006    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnnn7\" (UniqueName: \"kubernetes.io/projected/032b436b-bd82-4e71-a709-c58ce8cbf72e-kube-api-access-wnnn7\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.493166 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.493140    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/032b436b-bd82-4e71-a709-c58ce8cbf72e-tls-certs\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.493200 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.493185    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-tmp-dir\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.594407 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.594372    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/032b436b-bd82-4e71-a709-c58ce8cbf72e-tls-certs\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.594407 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.594409    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-tmp-dir\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.594642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.594492    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-home\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.594642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.594530    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-dshm\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.594642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.594550    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-model-cache\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.594642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.594618    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnnn7\" (UniqueName: \"kubernetes.io/projected/032b436b-bd82-4e71-a709-c58ce8cbf72e-kube-api-access-wnnn7\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.594936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.594912    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-home\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.595023 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.594976    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-tmp-dir\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.595067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.595037    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-model-cache\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.596951 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.596927    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-dshm\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.597072 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.597056    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/032b436b-bd82-4e71-a709-c58ce8cbf72e-tls-certs\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.657992 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.657915    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnnn7\" (UniqueName: \"kubernetes.io/projected/032b436b-bd82-4e71-a709-c58ce8cbf72e-kube-api-access-wnnn7\") pod \"distinct-w1-98a19b-kserve-8b7c44484-cmshr\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:39.699582 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:39.699550    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:40.078439 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:40.078410    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"]
Oct 30 19:44:40.080715 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:44:40.080679    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod032b436b_bd82_4e71_a709_c58ce8cbf72e.slice/crio-7db85af09dcb864ae5c8975db748499a694a7aa91da322520dd0ca5a44355f6c WatchSource:0}: Error finding container 7db85af09dcb864ae5c8975db748499a694a7aa91da322520dd0ca5a44355f6c: Status 404 returned error can't find the container with id 7db85af09dcb864ae5c8975db748499a694a7aa91da322520dd0ca5a44355f6c
Oct 30 19:44:40.457798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:40.457705    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" event={"ID":"032b436b-bd82-4e71-a709-c58ce8cbf72e","Type":"ContainerStarted","Data":"07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91"}
Oct 30 19:44:40.457798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:40.457753    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" event={"ID":"032b436b-bd82-4e71-a709-c58ce8cbf72e","Type":"ContainerStarted","Data":"7db85af09dcb864ae5c8975db748499a694a7aa91da322520dd0ca5a44355f6c"}
Oct 30 19:44:40.571421 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:40.571369    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" podStartSLOduration=1.571355117 podStartE2EDuration="1.571355117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:44:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:44:40.569242384 +0000 UTC m=+1143.112049657" watchObservedRunningTime="2026-10-30 19:44:40.571355117 +0000 UTC m=+1143.114162383"
Oct 30 19:44:40.702211 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:40.702170    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:42.381151 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:42.381116    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:44.908326 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:44.908282    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:46.954359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:46.954320    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:48.105662 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:48.105625    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:44:49.700118 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:49.700082    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:49.713297 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:49.713267    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:50.531099 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:50.531068    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:44:51.484400 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:51.484348    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:52.499850 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:52.499795    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:56.151606 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:56.151569    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:44:58.105198 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:44:58.105144    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:44:58.218540 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:44:58.218495    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:45:00.940945 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:00.940894    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:03.578639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:03.578595    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:45:05.582176 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:05.582141    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:10.177711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:10.177665    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:10.473206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:10.473109    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:10.717872 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:10.717827    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:11.225378 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.225344    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"]
Oct 30 19:45:11.229535 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.229516    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.270058 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.270016    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-dshm\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.270258 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.270070    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tls-certs\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.270258 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.270185    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tmp-dir\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.270411 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.270372    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-home\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.270522 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.270503    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw6b4\" (UniqueName: \"kubernetes.io/projected/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-kube-api-access-mw6b4\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.270607 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.270585    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-model-cache\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.325705 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.325675    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b0a183\"/\"e2e-conflict-b-c338110a-kserve-self-signed-certs\""
Oct 30 19:45:11.328013 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.327975    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"]
Oct 30 19:45:11.337444 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.337419    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:11.371539 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.371505    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tls-certs\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.371539 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.371543    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tmp-dir\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.371783 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.371640    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-home\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.371783 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.371746    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw6b4\" (UniqueName: \"kubernetes.io/projected/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-kube-api-access-mw6b4\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.371917 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.371781    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-model-cache\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.371917 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.371832    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-dshm\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.372353 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.372326    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tmp-dir\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.373583 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.373558    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-home\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.375829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.375730    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tls-certs\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.378063 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.378037    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-model-cache\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.383132 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.383090    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-dshm\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.434638 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.434601    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw6b4\" (UniqueName: \"kubernetes.io/projected/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-kube-api-access-mw6b4\") pod \"e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") " pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.542705 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.542681    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:11.917772 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:11.917744    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"]
Oct 30 19:45:11.919646 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:45:11.919620    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d857a2e_5d9f_499d_b7f5_9277db8d86e6.slice/crio-31d124cb2d9a24fde28503a08846bbbb5deb8da245e68b4020efbd75d670e698 WatchSource:0}: Error finding container 31d124cb2d9a24fde28503a08846bbbb5deb8da245e68b4020efbd75d670e698: Status 404 returned error can't find the container with id 31d124cb2d9a24fde28503a08846bbbb5deb8da245e68b4020efbd75d670e698
Oct 30 19:45:12.672306 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:12.672269    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v" event={"ID":"9d857a2e-5d9f-499d-b7f5-9277db8d86e6","Type":"ContainerStarted","Data":"f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959"}
Oct 30 19:45:12.672306 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:12.672310    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v" event={"ID":"9d857a2e-5d9f-499d-b7f5-9277db8d86e6","Type":"ContainerStarted","Data":"31d124cb2d9a24fde28503a08846bbbb5deb8da245e68b4020efbd75d670e698"}
Oct 30 19:45:12.797646 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:12.797591    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v" podStartSLOduration=1.797578369 podStartE2EDuration="1.797578369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:45:12.795010363 +0000 UTC m=+1175.337817628" watchObservedRunningTime="2026-10-30 19:45:12.797578369 +0000 UTC m=+1175.340385634"
Oct 30 19:45:13.543010 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:13.542972    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:13.578610 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:13.578568    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:45:14.883084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:14.883046    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:19.554877 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:19.554766    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:20.526412 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:20.526337    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:20.686145 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:20.686105    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:21.543521 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:21.543489    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:21.556730 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:21.556696    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:21.761108 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:21.761080    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:45:23.579212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:23.579173    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:45:24.416982 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:24.416945    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:26.870250 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:26.870215    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:27.453327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.453289    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"]
Oct 30 19:45:27.454625 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.454595    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:45:27.496306 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.496261    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"]
Oct 30 19:45:27.501110 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.501083    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.551598 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.551565    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-294332af605e\""
Oct 30 19:45:27.562910 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.562876    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"]
Oct 30 19:45:27.586656 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.586622    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-plugins-config-volume\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.586883 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.586675    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8bb\" (UniqueName: \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-kube-api-access-wv8bb\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.586965 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.586925    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-provider-credentials\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.587133 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.587111    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-routing-overlay-volume\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.688223 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.688186    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-provider-credentials\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.688447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.688339    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-routing-overlay-volume\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.688447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.688398    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-plugins-config-volume\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.688447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.688441    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8bb\" (UniqueName: \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-kube-api-access-wv8bb\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.689220 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.689192    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-routing-overlay-volume\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.689355 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.689254    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-plugins-config-volume\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.690998 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.690968    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-provider-credentials\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.748007 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.747928    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8bb\" (UniqueName: \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-kube-api-access-wv8bb\") pod \"payload-processing-external-model-7f9f45fffd-pq8mg\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:27.816749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:27.816707    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:28.192092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:28.192067    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"]
Oct 30 19:45:28.195631 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:45:28.195589    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57cd528_281c_48eb_9d1f_ef7d04a12ac6.slice/crio-80d011e96fb398ba28a7febd13cf938ee9081856a124e9f17169388c0f253ba8 WatchSource:0}: Error finding container 80d011e96fb398ba28a7febd13cf938ee9081856a124e9f17169388c0f253ba8: Status 404 returned error can't find the container with id 80d011e96fb398ba28a7febd13cf938ee9081856a124e9f17169388c0f253ba8
Oct 30 19:45:28.219900 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:45:28.219782    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:45:28.791400 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:28.791359    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" event={"ID":"c57cd528-281c-48eb-9d1f-ef7d04a12ac6","Type":"ContainerStarted","Data":"57d27b2936331aeaf16c087990cf3b75bc4585929cc3c61bba73bd8b44ccd679"}
Oct 30 19:45:28.791588 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:28.791423    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" event={"ID":"c57cd528-281c-48eb-9d1f-ef7d04a12ac6","Type":"ContainerStarted","Data":"80d011e96fb398ba28a7febd13cf938ee9081856a124e9f17169388c0f253ba8"}
Oct 30 19:45:28.791588 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:28.791444    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:45:28.904061 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:28.904000    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" podStartSLOduration=1.9039839280000002 podStartE2EDuration="1.903983928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:45:28.903507917 +0000 UTC m=+1191.446315183" watchObservedRunningTime="2026-10-30 19:45:28.903983928 +0000 UTC m=+1191.446791193"
Oct 30 19:45:29.052299 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:29.052248    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:32.453969 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.453930    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing" containerID="cri-o://2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61" gracePeriod=25
Oct 30 19:45:32.732193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.732166    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:45:32.765817 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.765773    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-routing-overlay-volume\") pod \"3601725e-928e-437a-a8e2-d142ef2b70de\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") "
Oct 30 19:45:32.766022 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.765933    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-kube-api-access-r7lrk\" (UniqueName: \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-kube-api-access-r7lrk\") pod \"3601725e-928e-437a-a8e2-d142ef2b70de\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") "
Oct 30 19:45:32.766022 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.765966    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-provider-credentials\" (UniqueName: \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-provider-credentials\") pod \"3601725e-928e-437a-a8e2-d142ef2b70de\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") "
Oct 30 19:45:32.766022 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.765998    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-plugins-config-volume\") pod \"3601725e-928e-437a-a8e2-d142ef2b70de\" (UID: \"3601725e-928e-437a-a8e2-d142ef2b70de\") "
Oct 30 19:45:32.766201 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.766167    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-routing-overlay-volume" pod "3601725e-928e-437a-a8e2-d142ef2b70de" (UID: "3601725e-928e-437a-a8e2-d142ef2b70de"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:45:32.766573 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.766551    6015 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-routing-overlay-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:45:32.766683 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.766609    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-plugins-config-volume" pod "3601725e-928e-437a-a8e2-d142ef2b70de" (UID: "3601725e-928e-437a-a8e2-d142ef2b70de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:45:32.768545 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.768516    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-kube-api-access-r7lrk" pod "3601725e-928e-437a-a8e2-d142ef2b70de" (UID: "3601725e-928e-437a-a8e2-d142ef2b70de"). InnerVolumeSpecName "kube-api-access-r7lrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:45:32.768649 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.768614    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-provider-credentials" pod "3601725e-928e-437a-a8e2-d142ef2b70de" (UID: "3601725e-928e-437a-a8e2-d142ef2b70de"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:45:32.818901 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.818857    6015 generic.go:356] "Generic (PLEG): container finished" podID="3601725e-928e-437a-a8e2-d142ef2b70de" containerID="2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61" exitCode=0
Oct 30 19:45:32.818901 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.818904    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"
Oct 30 19:45:32.819109 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.818905    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" event={"ID":"3601725e-928e-437a-a8e2-d142ef2b70de","Type":"ContainerDied","Data":"2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61"}
Oct 30 19:45:32.819109 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.819040    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-5dc946644f-sxthh" event={"ID":"3601725e-928e-437a-a8e2-d142ef2b70de","Type":"ContainerDied","Data":"1b564d1508d5234c8b0ad4275d92f425a8564592edfe5a853b8f69c039b90e74"}
Oct 30 19:45:32.819109 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.819064    6015 scope.go:122] "RemoveContainer" containerID="2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61"
Oct 30 19:45:32.829560 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.829540    6015 scope.go:122] "RemoveContainer" containerID="2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61"
Oct 30 19:45:32.829874 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:45:32.829854    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61\": container with ID starting with 2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61 not found: ID does not exist" containerID="2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61"
Oct 30 19:45:32.829928 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.829885    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61"} err="failed to get container status \"2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61\": rpc error: code = NotFound desc = could not find container \"2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61\": container with ID starting with 2d99e5443e45e86c6545bd929a2b32296727adf1366392675f19c652d0d16a61 not found: ID does not exist"
Oct 30 19:45:32.868160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.868124    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7lrk\" (UniqueName: \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-kube-api-access-r7lrk\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:45:32.868160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.868155    6015 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/3601725e-928e-437a-a8e2-d142ef2b70de-provider-credentials\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:45:32.868160 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.868169    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3601725e-928e-437a-a8e2-d142ef2b70de-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:45:32.993562 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:32.993477    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"]
Oct 30 19:45:33.002472 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:33.002431    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-5dc946644f-sxthh"]
Oct 30 19:45:33.592985 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:33.591242    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" path="/var/lib/kubelet/pods/3601725e-928e-437a-a8e2-d142ef2b70de/volumes"
Oct 30 19:45:33.937543 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:33.937448    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:38.655622 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:38.655586    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:39.800537 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:39.800499    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:45:43.280387 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:43.280349    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:45.331733 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.331696    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:45.587496 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.587388    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"]
Oct 30 19:45:45.588232 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.588211    6015 cpu_manager.go:414] "containerMap: removing container" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing"
Oct 30 19:45:45.588232 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.588234    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing"
Oct 30 19:45:45.588419 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.588406    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="3601725e-928e-437a-a8e2-d142ef2b70de" containerName="payload-processing"
Oct 30 19:45:45.593826 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.593787    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.628145 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.628115    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-home\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.628145 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.628149    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-dshm\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.628430 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.628405    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlv28\" (UniqueName: \"kubernetes.io/projected/23b6d445-7b28-4f9f-aecc-874ff146099e-kube-api-access-xlv28\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.628546 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.628521    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-model-cache\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.628600 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.628584    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-tmp-dir\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.628652 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.628616    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23b6d445-7b28-4f9f-aecc-874ff146099e-tls-certs\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.642947 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.642920    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"]
Oct 30 19:45:45.687761 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.687712    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a74d15\"/\"kube-root-ca.crt\""
Oct 30 19:45:45.687761 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.687721    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a74d15\"/\"openshift-service-ca.crt\""
Oct 30 19:45:45.689345 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.689318    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:45.692075 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.692058    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a74d15\"/\"default-dockercfg-4fxps\""
Oct 30 19:45:45.692364 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.692345    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a74d15\"/\"distinct-w0-a74d15-kserve-self-signed-certs\""
Oct 30 19:45:45.729758 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.729715    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlv28\" (UniqueName: \"kubernetes.io/projected/23b6d445-7b28-4f9f-aecc-874ff146099e-kube-api-access-xlv28\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.730029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.729844    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-model-cache\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.730029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.729891    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-tmp-dir\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.730029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.729914    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23b6d445-7b28-4f9f-aecc-874ff146099e-tls-certs\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.730029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.730008    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-home\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.730029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.730033    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-dshm\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.731279 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.731246    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-model-cache\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.732001 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.731937    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-home\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.734754 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.734429    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23b6d445-7b28-4f9f-aecc-874ff146099e-tls-certs\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.738651 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.737672    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-tmp-dir\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.750680 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.747748    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-dshm\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.797634 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.797590    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlv28\" (UniqueName: \"kubernetes.io/projected/23b6d445-7b28-4f9f-aecc-874ff146099e-kube-api-access-xlv28\") pod \"distinct-w0-a74d15-kserve-7855c49875-jgjkn\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") " pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:45.919857 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:45.919735    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:46.308875 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:46.308843    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"]
Oct 30 19:45:46.311390 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:45:46.311353    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23b6d445_7b28_4f9f_aecc_874ff146099e.slice/crio-9e25ff74d656e6594c97b49c0b531e0a486e441f94c8c60d57c1ca09d41f4ccf WatchSource:0}: Error finding container 9e25ff74d656e6594c97b49c0b531e0a486e441f94c8c60d57c1ca09d41f4ccf: Status 404 returned error can't find the container with id 9e25ff74d656e6594c97b49c0b531e0a486e441f94c8c60d57c1ca09d41f4ccf
Oct 30 19:45:46.921335 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:46.921296    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn" event={"ID":"23b6d445-7b28-4f9f-aecc-874ff146099e","Type":"ContainerStarted","Data":"b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e"}
Oct 30 19:45:46.921740 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:46.921343    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn" event={"ID":"23b6d445-7b28-4f9f-aecc-874ff146099e","Type":"ContainerStarted","Data":"9e25ff74d656e6594c97b49c0b531e0a486e441f94c8c60d57c1ca09d41f4ccf"}
Oct 30 19:45:47.043393 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.043339    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn" podStartSLOduration=2.043324603 podStartE2EDuration="2.043324603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:45:47.043038042 +0000 UTC m=+1209.585845308" watchObservedRunningTime="2026-10-30 19:45:47.043324603 +0000 UTC m=+1209.586131869"
Oct 30 19:45:47.385339 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.385303    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"]
Oct 30 19:45:47.389295 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.389266    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.454411 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.454357    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-data\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.454587 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.454431    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.454637 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.454581    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-credential-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.454678 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.454633    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-podinfo\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.454714 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.454684    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/017278f7-1f6f-490e-9a81-03a1ce84c448-istiod-ca-cert\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.454746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.454717    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-envoy\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.454876 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.454854    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkdjt\" (UniqueName: \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-kube-api-access-mkdjt\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.454992 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.454967    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-certs\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.455068 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.455051    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-token\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.515097 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.514746    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"]
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.556072    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-token\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.556161    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-data\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.556210    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.556268    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-credential-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.556328    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-podinfo\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.556353    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/017278f7-1f6f-490e-9a81-03a1ce84c448-istiod-ca-cert\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.556389    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-envoy\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.556460    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkdjt\" (UniqueName: \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-kube-api-access-mkdjt\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.556543    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-certs\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.557078    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-certs\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.557164    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.557437    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-credential-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.558124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.558002    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-data\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.559199 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.558257    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/017278f7-1f6f-490e-9a81-03a1ce84c448-istiod-ca-cert\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.560225 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.560198    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-envoy\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.562335 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.562298    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-podinfo\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.624756 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.624722    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkdjt\" (UniqueName: \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-kube-api-access-mkdjt\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.625053 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.625029    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-token\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.705025 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.704938    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:47.920689 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:47.920656    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:48.008767 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:48.008685    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:48.144723 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:48.144693    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"]
Oct 30 19:45:48.145582 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:45:48.145545    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017278f7_1f6f_490e_9a81_03a1ce84c448.slice/crio-1411bc2b79926eb57c014169fe3a37bcd328877158364febb3c26c6f8ead6090 WatchSource:0}: Error finding container 1411bc2b79926eb57c014169fe3a37bcd328877158364febb3c26c6f8ead6090: Status 404 returned error can't find the container with id 1411bc2b79926eb57c014169fe3a37bcd328877158364febb3c26c6f8ead6090
Oct 30 19:45:48.148189 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:48.148154    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:45:48.148302 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:48.148241    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:45:48.148302 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:48.148287    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:45:48.937571 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:48.937531    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" event={"ID":"017278f7-1f6f-490e-9a81-03a1ce84c448","Type":"ContainerStarted","Data":"291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc"}
Oct 30 19:45:48.937759 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:48.937586    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" event={"ID":"017278f7-1f6f-490e-9a81-03a1ce84c448","Type":"ContainerStarted","Data":"1411bc2b79926eb57c014169fe3a37bcd328877158364febb3c26c6f8ead6090"}
Oct 30 19:45:49.102058 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:49.101998    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" podStartSLOduration=2.101982863 podStartE2EDuration="2.101982863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:45:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:45:49.10008772 +0000 UTC m=+1211.642894984" watchObservedRunningTime="2026-10-30 19:45:49.101982863 +0000 UTC m=+1211.644790127"
Oct 30 19:45:49.705404 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:49.705373    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:49.707289 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:49.707266    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 19:45:49.707406 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:49.707328    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 19:45:49.798269 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:49.798224    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:45:50.706212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:50.706177    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 19:45:50.706638 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:50.706236    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 19:45:51.706114 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:51.706080    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 19:45:51.706298 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:51.706135    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 19:45:52.706142 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:52.706110    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 19:45:52.706332 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:52.706181    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 19:45:52.718417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:52.718381    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:53.705956 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:53.705923    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 19:45:53.706141 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:53.705980    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 19:45:54.705681 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:54.705641    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 30 19:45:54.706112 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:54.705751    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 30 19:45:55.710101 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:55.710070    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:55.710574 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:55.710542    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:55.711606 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:55.711583    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:45:55.920790 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:55.920756    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:55.933594 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:55.933569    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:55.996445 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:55.996355    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:45:57.505735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:57.505699    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:45:58.218735 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:45:58.218692    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:45:59.798952 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:45:59.798912    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:46:02.253756 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:02.253712    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:03.548279 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.548242    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"]
Oct 30 19:46:03.552287 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.552271    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.651746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.651713    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-98a19b\"/\"distinct-2-w1-98a19b-kserve-self-signed-certs\""
Oct 30 19:46:03.654219 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.654196    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"]
Oct 30 19:46:03.681885 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.681851    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-model-cache\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.682083 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.681962    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-dshm\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.682083 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.682029    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4a770e-321c-4c47-93dc-2ebff03fb985-tls-certs\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.682185 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.682121    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-home\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.682241 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.682217    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-tmp-dir\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.682293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.682278    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78wnj\" (UniqueName: \"kubernetes.io/projected/6c4a770e-321c-4c47-93dc-2ebff03fb985-kube-api-access-78wnj\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.783291 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.783252    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-model-cache\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.783481 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.783360    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-dshm\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.783481 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.783395    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4a770e-321c-4c47-93dc-2ebff03fb985-tls-certs\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.783481 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.783466    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-home\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.783654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.783509    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-tmp-dir\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.783654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.783566    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78wnj\" (UniqueName: \"kubernetes.io/projected/6c4a770e-321c-4c47-93dc-2ebff03fb985-kube-api-access-78wnj\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.783929 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.783709    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-model-cache\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.783929 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.783857    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-home\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.784029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.784003    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-tmp-dir\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.785930 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.785901    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-dshm\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.786191 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.786171    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4a770e-321c-4c47-93dc-2ebff03fb985-tls-certs\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.791422 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.791393    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:03.844093 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.844020    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78wnj\" (UniqueName: \"kubernetes.io/projected/6c4a770e-321c-4c47-93dc-2ebff03fb985-kube-api-access-78wnj\") pod \"distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") " pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:03.864966 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:03.864929    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:04.239172 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:04.239146    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"]
Oct 30 19:46:04.241323 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:46:04.241297    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c4a770e_321c_4c47_93dc_2ebff03fb985.slice/crio-c323e970dd7d868131a7fa4bf6ef0c702c9ba00c471aeca122790d09582dc793 WatchSource:0}: Error finding container c323e970dd7d868131a7fa4bf6ef0c702c9ba00c471aeca122790d09582dc793: Status 404 returned error can't find the container with id c323e970dd7d868131a7fa4bf6ef0c702c9ba00c471aeca122790d09582dc793
Oct 30 19:46:05.045429 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:05.045391    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" event={"ID":"6c4a770e-321c-4c47-93dc-2ebff03fb985","Type":"ContainerStarted","Data":"469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8"}
Oct 30 19:46:05.045837 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:05.045442    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" event={"ID":"6c4a770e-321c-4c47-93dc-2ebff03fb985","Type":"ContainerStarted","Data":"c323e970dd7d868131a7fa4bf6ef0c702c9ba00c471aeca122790d09582dc793"}
Oct 30 19:46:05.162201 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:05.162146    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" podStartSLOduration=2.162129916 podStartE2EDuration="2.162129916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:46:05.160603799 +0000 UTC m=+1227.703411065" watchObservedRunningTime="2026-10-30 19:46:05.162129916 +0000 UTC m=+1227.704937181"
Oct 30 19:46:05.865318 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:05.865283    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:06.866875 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:06.866842    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:07.602643 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:07.602607    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"]
Oct 30 19:46:07.639421 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:07.639375    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:09.799424 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:09.799380    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:46:11.573565 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:11.573532    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:11.941907 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:11.941794    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:13.866097 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:13.866044    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:13.886726 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:13.886688    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:14.171888 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:14.171321    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:46:16.275206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:16.275171    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:19.798612 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:19.798569    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:46:20.878450 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:20.878413    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:22.624015 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:22.623958    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v" podUID="9d857a2e-5d9f-499d-b7f5-9277db8d86e6" containerName="main" containerID="cri-o://f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959" gracePeriod=45
Oct 30 19:46:22.750329 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:22.750277    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v" podUID="9d857a2e-5d9f-499d-b7f5-9277db8d86e6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": dial tcp 10.134.0.61:8000: connect: connection refused"
Oct 30 19:46:22.906537 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:22.906501    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:46:23.054168 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.054130    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-kube-api-access-mw6b4\" (UniqueName: \"kubernetes.io/projected/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-kube-api-access-mw6b4\") pod \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") "
Oct 30 19:46:23.054368 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.054254    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tmp-dir\") pod \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") "
Oct 30 19:46:23.054368 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.054293    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-dshm\") pod \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") "
Oct 30 19:46:23.054508 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.054485    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-model-cache\") pod \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") "
Oct 30 19:46:23.054572 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.054531    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-home\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-home\") pod \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") "
Oct 30 19:46:23.054625 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.054576    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tls-certs\" (UniqueName: \"kubernetes.io/secret/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tls-certs\") pod \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\" (UID: \"9d857a2e-5d9f-499d-b7f5-9277db8d86e6\") "
Oct 30 19:46:23.054625 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.054592    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tmp-dir" pod "9d857a2e-5d9f-499d-b7f5-9277db8d86e6" (UID: "9d857a2e-5d9f-499d-b7f5-9277db8d86e6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:46:23.054800 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.054751    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-model-cache" pod "9d857a2e-5d9f-499d-b7f5-9277db8d86e6" (UID: "9d857a2e-5d9f-499d-b7f5-9277db8d86e6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:46:23.054894 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.054859    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-home" pod "9d857a2e-5d9f-499d-b7f5-9277db8d86e6" (UID: "9d857a2e-5d9f-499d-b7f5-9277db8d86e6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:46:23.055120 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.055101    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:46:23.055184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.055126    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:46:23.055184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.055141    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:46:23.056791 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.056768    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-kube-api-access-mw6b4" pod "9d857a2e-5d9f-499d-b7f5-9277db8d86e6" (UID: "9d857a2e-5d9f-499d-b7f5-9277db8d86e6"). InnerVolumeSpecName "kube-api-access-mw6b4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:46:23.057002 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.056977    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-dshm" pod "9d857a2e-5d9f-499d-b7f5-9277db8d86e6" (UID: "9d857a2e-5d9f-499d-b7f5-9277db8d86e6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:46:23.057130 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.057114    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tls-certs" pod "9d857a2e-5d9f-499d-b7f5-9277db8d86e6" (UID: "9d857a2e-5d9f-499d-b7f5-9277db8d86e6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:46:23.156867 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.156741    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:46:23.156867 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.156775    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw6b4\" (UniqueName: \"kubernetes.io/projected/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-kube-api-access-mw6b4\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:46:23.156867 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.156788    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d857a2e-5d9f-499d-b7f5-9277db8d86e6-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:46:23.177973 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.177943    6015 generic.go:356] "Generic (PLEG): container finished" podID="9d857a2e-5d9f-499d-b7f5-9277db8d86e6" containerID="f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959" exitCode=0
Oct 30 19:46:23.178143 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.177987    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"
Oct 30 19:46:23.178143 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.178035    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v" event={"ID":"9d857a2e-5d9f-499d-b7f5-9277db8d86e6","Type":"ContainerDied","Data":"f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959"}
Oct 30 19:46:23.178143 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.178079    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v" event={"ID":"9d857a2e-5d9f-499d-b7f5-9277db8d86e6","Type":"ContainerDied","Data":"31d124cb2d9a24fde28503a08846bbbb5deb8da245e68b4020efbd75d670e698"}
Oct 30 19:46:23.178143 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.178096    6015 scope.go:122] "RemoveContainer" containerID="f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959"
Oct 30 19:46:23.188926 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.188902    6015 scope.go:122] "RemoveContainer" containerID="f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959"
Oct 30 19:46:23.189233 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:46:23.189214    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959\": container with ID starting with f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959 not found: ID does not exist" containerID="f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959"
Oct 30 19:46:23.189276 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.189243    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959"} err="failed to get container status \"f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959\": rpc error: code = NotFound desc = could not find container \"f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959\": container with ID starting with f292d695f54f0efb5fb9fe6b7800976ead64e0887de7cb97c9d6f346285b8959 not found: ID does not exist"
Oct 30 19:46:23.334784 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.334745    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"]
Oct 30 19:46:23.341385 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.341355    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/e2e-conflict-b-c338110a-kserve-f7df49f5c-lff5v"]
Oct 30 19:46:23.586544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:23.586510    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d857a2e-5d9f-499d-b7f5-9277db8d86e6" path="/var/lib/kubelet/pods/9d857a2e-5d9f-499d-b7f5-9277db8d86e6/volumes"
Oct 30 19:46:25.476397 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:25.476367    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:28.217438 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:46:28.217402    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:46:29.798498 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:29.798465    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:46:30.064029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:30.063940    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:32.721842 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.721778    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"]
Oct 30 19:46:32.722738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.722714    6015 cpu_manager.go:414] "containerMap: removing container" podUID="9d857a2e-5d9f-499d-b7f5-9277db8d86e6" containerName="main"
Oct 30 19:46:32.722798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.722743    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d857a2e-5d9f-499d-b7f5-9277db8d86e6" containerName="main"
Oct 30 19:46:32.723118 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.723097    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d857a2e-5d9f-499d-b7f5-9277db8d86e6" containerName="main"
Oct 30 19:46:32.728555 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.728528    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.787709 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.787655    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-envoy\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.787709 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.787705    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-certs\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.788116 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.787765    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-data\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.788116 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.788002    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-token\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.788116 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.788066    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-credential-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.788302 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.788194    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.788302 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.788293    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk9b5\" (UniqueName: \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-kube-api-access-lk9b5\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.788440 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.788344    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-podinfo\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.788440 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.788414    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istiod-ca-cert\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.819776 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.819733    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"]
Oct 30 19:46:32.889747 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.889711    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk9b5\" (UniqueName: \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-kube-api-access-lk9b5\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.889989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.889770    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-podinfo\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.889989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.889853    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istiod-ca-cert\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.889989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.889890    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-envoy\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.889989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.889918    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-certs\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.890313 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.890283    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-certs\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.890388 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.890304    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-data\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.890553 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.890534    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-data\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.890553 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.890531    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-token\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.890714 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.890613    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-credential-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.890714 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.890699    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.891081 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.891058    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.891159 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.891105    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-credential-socket\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.891933 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.891912    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istiod-ca-cert\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.893072 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.893047    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-envoy\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.893420 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.893397    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-podinfo\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.949426 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.949352    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-token\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:32.949426 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:32.949388    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk9b5\" (UniqueName: \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-kube-api-access-lk9b5\") pod \"e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") " pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:33.045290 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:33.045244    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:33.736833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:33.728644    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"]
Oct 30 19:46:33.752951 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:46:33.752906    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9b6e9a_6dce_4266_8cdc_c8f1fb8741e2.slice/crio-8897e1670e9b6871daf64ce3b295146f8d6f196ad535948aedea7be02026e555 WatchSource:0}: Error finding container 8897e1670e9b6871daf64ce3b295146f8d6f196ad535948aedea7be02026e555: Status 404 returned error can't find the container with id 8897e1670e9b6871daf64ce3b295146f8d6f196ad535948aedea7be02026e555
Oct 30 19:46:33.755289 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:33.755260    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:46:33.755343 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:33.755334    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:46:33.755383 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:33.755368    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:46:34.257768 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:34.257736    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" event={"ID":"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2","Type":"ContainerStarted","Data":"162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7"}
Oct 30 19:46:34.257964 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:34.257789    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" event={"ID":"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2","Type":"ContainerStarted","Data":"8897e1670e9b6871daf64ce3b295146f8d6f196ad535948aedea7be02026e555"}
Oct 30 19:46:34.770835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:34.769482    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:35.045867 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:35.045832    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:35.047226 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:35.047200    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 19:46:35.047358 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:35.047248    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 19:46:36.046741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:36.046699    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 19:46:36.047135 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:36.046770    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 19:46:37.045752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:37.045707    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 19:46:37.045992 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:37.045773    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 19:46:38.046438 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:38.046398    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 19:46:38.046882 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:38.046472    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 19:46:39.046007 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:39.045972    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 19:46:39.046207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:39.046026    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 19:46:39.519713 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:39.519608    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:39.799194 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:39.799162    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:46:40.046421 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:40.046383    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 30 19:46:40.046599 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:40.046442    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 30 19:46:40.435620 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:40.435586    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:40.578919 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:40.578875    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:46:40.588355 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:40.588326    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:40.749130 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:40.749044    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:41.059888 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:41.059852    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:41.060291 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:41.060269    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:41.061101 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:41.061080    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:46:41.225020 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:41.224968    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" podStartSLOduration=9.224953144 podStartE2EDuration="9.224953144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:46:34.374976603 +0000 UTC m=+1256.917783894" watchObservedRunningTime="2026-10-30 19:46:41.224953144 +0000 UTC m=+1263.767760408"
Oct 30 19:46:44.618056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:44.618001    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:45.073302 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.073257    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"]
Oct 30 19:46:45.074851 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.074789    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:46:45.118883 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.118845    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"]
Oct 30 19:46:45.124538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.124514    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.176106 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.176054    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-ca43c772526a\""
Oct 30 19:46:45.176106 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.176064    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-7794e822d3e6\""
Oct 30 19:46:45.178684 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.178653    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"]
Oct 30 19:46:45.220998 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.220961    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-routing-overlay-volume\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.221180 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.221017    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55fz5\" (UniqueName: \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-kube-api-access-55fz5\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.221180 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.221063    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-provider-credentials\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.221256 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.221186    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-plugins-config-volume\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.322343 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.322288    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-routing-overlay-volume\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.322343 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.322353    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55fz5\" (UniqueName: \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-kube-api-access-55fz5\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.322626 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.322407    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-provider-credentials\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.322626 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.322457    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-plugins-config-volume\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.323102 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.323076    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-routing-overlay-volume\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.323198 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.323178    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-plugins-config-volume\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.325278 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.325233    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-provider-credentials\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.384447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.384414    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55fz5\" (UniqueName: \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-kube-api-access-55fz5\") pod \"payload-processing-external-model-596cf5558c-jj48j\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") " pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.427727 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.427696    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:45.439586 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.439554    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:45.631350 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.631096    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:45.822043 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:45.822010    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"]
Oct 30 19:46:45.824141 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:46:45.824112    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b4e426_b79b_4e99_bf2e_232a1f74c668.slice/crio-640e75f0518ccfd46813d9ccc191902571a3a01de68d1a614b2ab432ffb5fe54 WatchSource:0}: Error finding container 640e75f0518ccfd46813d9ccc191902571a3a01de68d1a614b2ab432ffb5fe54: Status 404 returned error can't find the container with id 640e75f0518ccfd46813d9ccc191902571a3a01de68d1a614b2ab432ffb5fe54
Oct 30 19:46:46.357023 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:46.356981    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j" event={"ID":"46b4e426-b79b-4e99-bf2e-232a1f74c668","Type":"ContainerStarted","Data":"c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef"}
Oct 30 19:46:46.357210 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:46.357049    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:46.357210 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:46.357067    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j" event={"ID":"46b4e426-b79b-4e99-bf2e-232a1f74c668","Type":"ContainerStarted","Data":"640e75f0518ccfd46813d9ccc191902571a3a01de68d1a614b2ab432ffb5fe54"}
Oct 30 19:46:46.470941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:46.470883    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j" podStartSLOduration=1.470865741 podStartE2EDuration="1.470865741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:46:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:46:46.46819196 +0000 UTC m=+1269.010999226" watchObservedRunningTime="2026-10-30 19:46:46.470865741 +0000 UTC m=+1269.013673045"
Oct 30 19:46:49.824513 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:49.824451    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:50.074002 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.073952    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing" containerID="cri-o://57d27b2936331aeaf16c087990cf3b75bc4585929cc3c61bba73bd8b44ccd679" gracePeriod=25
Oct 30 19:46:50.406671 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.406310    6015 generic.go:356] "Generic (PLEG): container finished" podID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerID="57d27b2936331aeaf16c087990cf3b75bc4585929cc3c61bba73bd8b44ccd679" exitCode=0
Oct 30 19:46:50.406671 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.406541    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" event={"ID":"c57cd528-281c-48eb-9d1f-ef7d04a12ac6","Type":"ContainerDied","Data":"57d27b2936331aeaf16c087990cf3b75bc4585929cc3c61bba73bd8b44ccd679"}
Oct 30 19:46:50.860188 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.860155    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:46:50.958158 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.958056    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-plugins-config-volume\") pod \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") "
Oct 30 19:46:50.958158 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.958133    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-provider-credentials\" (UniqueName: \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-provider-credentials\") pod \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") "
Oct 30 19:46:50.958372 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.958239    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-routing-overlay-volume\") pod \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") "
Oct 30 19:46:50.958372 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.958307    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-kube-api-access-wv8bb\" (UniqueName: \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-kube-api-access-wv8bb\") pod \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\" (UID: \"c57cd528-281c-48eb-9d1f-ef7d04a12ac6\") "
Oct 30 19:46:50.958604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.958579    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-plugins-config-volume" pod "c57cd528-281c-48eb-9d1f-ef7d04a12ac6" (UID: "c57cd528-281c-48eb-9d1f-ef7d04a12ac6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:46:50.958711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.958648    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-routing-overlay-volume" pod "c57cd528-281c-48eb-9d1f-ef7d04a12ac6" (UID: "c57cd528-281c-48eb-9d1f-ef7d04a12ac6"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:46:50.958771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.958744    6015 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-routing-overlay-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:46:50.958771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.958762    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:46:50.960494 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.960474    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-provider-credentials" pod "c57cd528-281c-48eb-9d1f-ef7d04a12ac6" (UID: "c57cd528-281c-48eb-9d1f-ef7d04a12ac6"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:46:50.960611 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:50.960589    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-kube-api-access-wv8bb" pod "c57cd528-281c-48eb-9d1f-ef7d04a12ac6" (UID: "c57cd528-281c-48eb-9d1f-ef7d04a12ac6"). InnerVolumeSpecName "kube-api-access-wv8bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:46:51.062879 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:51.062835    6015 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-provider-credentials\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:46:51.099892 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:51.091873    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv8bb\" (UniqueName: \"kubernetes.io/projected/c57cd528-281c-48eb-9d1f-ef7d04a12ac6-kube-api-access-wv8bb\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:46:51.448088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:51.445593    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"
Oct 30 19:46:51.448088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:51.446078    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg" event={"ID":"c57cd528-281c-48eb-9d1f-ef7d04a12ac6","Type":"ContainerDied","Data":"80d011e96fb398ba28a7febd13cf938ee9081856a124e9f17169388c0f253ba8"}
Oct 30 19:46:51.448088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:51.446152    6015 scope.go:122] "RemoveContainer" containerID="57d27b2936331aeaf16c087990cf3b75bc4585929cc3c61bba73bd8b44ccd679"
Oct 30 19:46:51.643832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:51.637317    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"]
Oct 30 19:46:51.665988 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:51.665951    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-pq8mg"]
Oct 30 19:46:53.588538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:53.588500    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" path="/var/lib/kubelet/pods/c57cd528-281c-48eb-9d1f-ef7d04a12ac6/volumes"
Oct 30 19:46:55.124125 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:55.124084    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:46:57.368500 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:46:57.368460    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:46:58.218682 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:46:58.218645    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:47:00.225137 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:00.225098    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:00.421884 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:00.421843    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:02.868905 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:02.868869    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:05.306855 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:05.306771    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:08.931576 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:08.931538    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"]
Oct 30 19:47:08.932148 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:08.932116    6015 cpu_manager.go:414] "containerMap: removing container" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing"
Oct 30 19:47:08.932148 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:08.932143    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing"
Oct 30 19:47:08.932301 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:08.932263    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="c57cd528-281c-48eb-9d1f-ef7d04a12ac6" containerName="payload-processing"
Oct 30 19:47:08.935991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:08.935972    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.032383 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.032348    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b0a183\"/\"distinct-w2-b0a183-kserve-self-signed-certs\""
Oct 30 19:47:09.034196 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.034169    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:09.036642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.036614    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"]
Oct 30 19:47:09.049115 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.049082    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-home\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.049252 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.049209    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vxtz\" (UniqueName: \"kubernetes.io/projected/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-kube-api-access-2vxtz\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.049304 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.049273    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tmp-dir\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.049410 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.049395    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-dshm\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.049486 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.049451    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tls-certs\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.049546 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.049505    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-model-cache\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.150512 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.150478    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-home\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.150694 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.150562    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vxtz\" (UniqueName: \"kubernetes.io/projected/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-kube-api-access-2vxtz\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.150694 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.150608    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tmp-dir\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.150694 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.150672    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-dshm\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.150883 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.150706    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tls-certs\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.150883 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.150749    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-model-cache\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.150989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.150920    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-home\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.151046 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.151030    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tmp-dir\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.151191 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.151171    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-model-cache\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.153285 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.153263    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-dshm\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.153531 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.153508    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tls-certs\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.212895 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.212822    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vxtz\" (UniqueName: \"kubernetes.io/projected/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-kube-api-access-2vxtz\") pod \"distinct-w2-b0a183-kserve-89fb89786-7rh2h\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") " pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.250047 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.250006    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:09.651393 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:09.651364    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"]
Oct 30 19:47:09.653307 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:47:09.653278    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f0448ac_72d9_4fa4_bbe4_9cadfc4af088.slice/crio-4ec1eec3697ea425da9cd386e0bb0ba21bc9ef433d28b02660a4e912245bbe6f WatchSource:0}: Error finding container 4ec1eec3697ea425da9cd386e0bb0ba21bc9ef433d28b02660a4e912245bbe6f: Status 404 returned error can't find the container with id 4ec1eec3697ea425da9cd386e0bb0ba21bc9ef433d28b02660a4e912245bbe6f
Oct 30 19:47:10.413929 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:10.413895    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:10.565052 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:10.565011    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" event={"ID":"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088","Type":"ContainerStarted","Data":"3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1"}
Oct 30 19:47:10.565052 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:10.565058    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" event={"ID":"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088","Type":"ContainerStarted","Data":"4ec1eec3697ea425da9cd386e0bb0ba21bc9ef433d28b02660a4e912245bbe6f"}
Oct 30 19:47:11.255832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:11.251932    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:15.715751 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:15.715714    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:19.250781 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:19.250742    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:19.263939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:19.263910    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:19.376912 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:19.376843    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" podStartSLOduration=11.376822587 podStartE2EDuration="11.376822587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:10.689303031 +0000 UTC m=+1293.232110297" watchObservedRunningTime="2026-10-30 19:47:19.376822587 +0000 UTC m=+1301.919629845"
Oct 30 19:47:19.797872 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:19.797845    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:47:20.735161 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:20.735123    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:25.764308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:25.764268    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:28.215749 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:47:28.215714    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:47:30.906585 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:30.906540    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:33.795983 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:33.795929    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Oct 30 19:47:34.130997 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:34.130897    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" podUID="6c4a770e-321c-4c47-93dc-2ebff03fb985" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:47:36.397960 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:36.397922    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:41.746784 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:41.746746    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:45.946252 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:45.946215    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:46.814446 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:46.814400    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:51.801665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:51.801620    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:55.167244 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:55.167200    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:55.415479 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:55.415442    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:47:56.476150 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.476112    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"]
Oct 30 19:47:56.480365 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.480341    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.581878 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.581842    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"]
Oct 30 19:47:56.593082 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.593040    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-routing-overlay-volume\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.593288 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.593193    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68h59\" (UniqueName: \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-kube-api-access-68h59\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.593288 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.593240    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-provider-credentials\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.593490 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.593454    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-plugins-config-volume\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.694975 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.694932    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-routing-overlay-volume\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.695302 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.695280    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68h59\" (UniqueName: \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-kube-api-access-68h59\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.695459 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.695337    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-provider-credentials\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.695547 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.695480    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-plugins-config-volume\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.695752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.695732    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-routing-overlay-volume\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.696295 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.696272    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-plugins-config-volume\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.698674 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.698647    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-provider-credentials\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.755057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.754980    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68h59\" (UniqueName: \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-kube-api-access-68h59\") pod \"payload-processing-external-model-7f9f45fffd-z2xgj\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") " pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:56.794340 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:56.794305    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:57.184464 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:57.178436    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"]
Oct 30 19:47:57.197846 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:47:57.197307    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480c838e_6da3_47c0_9bd5_a8154efaf2e7.slice/crio-9d1e50cb6aa86a0599e8e35f49f8758b110c6e8e0710898d3d24870c3af3dbdf WatchSource:0}: Error finding container 9d1e50cb6aa86a0599e8e35f49f8758b110c6e8e0710898d3d24870c3af3dbdf: Status 404 returned error can't find the container with id 9d1e50cb6aa86a0599e8e35f49f8758b110c6e8e0710898d3d24870c3af3dbdf
Oct 30 19:47:58.077022 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:58.076974    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj" event={"ID":"480c838e-6da3-47c0-9bd5-a8154efaf2e7","Type":"ContainerStarted","Data":"4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f"}
Oct 30 19:47:58.077494 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:58.077040    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj" event={"ID":"480c838e-6da3-47c0-9bd5-a8154efaf2e7","Type":"ContainerStarted","Data":"9d1e50cb6aa86a0599e8e35f49f8758b110c6e8e0710898d3d24870c3af3dbdf"}
Oct 30 19:47:58.077494 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:58.077084    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:47:58.191134 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:58.191070    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj" podStartSLOduration=2.191049797 podStartE2EDuration="2.191049797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:47:58.188068211 +0000 UTC m=+1340.730875475" watchObservedRunningTime="2026-10-30 19:47:58.191049797 +0000 UTC m=+1340.733857062"
Oct 30 19:47:58.218444 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:47:58.218400    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:47:58.408219 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:47:58.408121    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:02.330018 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:02.329983    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:05.848241 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:05.848204    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"]
Oct 30 19:48:05.852590 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:05.852570    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:05.933932 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:05.933894    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"]
Oct 30 19:48:06.015531 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.015490    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.015707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.015611    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.015707 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.015657    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.015787 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.015761    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fca59b7-1f91-4633-910e-688571b7abd3-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.015872 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.015794    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbrjx\" (UniqueName: \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-kube-api-access-lbrjx\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.015918 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.015910    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.015960 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.015934    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.016023 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.016008    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fca59b7-1f91-4633-910e-688571b7abd3-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.016060 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.016048    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.117511 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.117415    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.117511 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.117489    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.117511 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.117513    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.117839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.117575    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fca59b7-1f91-4633-910e-688571b7abd3-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.117839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.117604    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbrjx\" (UniqueName: \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-kube-api-access-lbrjx\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.117839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.117680    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.117839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.117713    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.117839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.117770    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fca59b7-1f91-4633-910e-688571b7abd3-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.117839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.117837    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.118145 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.117955    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.118145 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.118026    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.118145 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.118135    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.118293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.118225    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.118405 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.118380    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fca59b7-1f91-4633-910e-688571b7abd3-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.120273 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.120248    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.120466 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.120447    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fca59b7-1f91-4633-910e-688571b7abd3-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.176214 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.176182    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.176537 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.176511    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbrjx\" (UniqueName: \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-kube-api-access-lbrjx\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.471155 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.471059    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:06.898917 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.898862    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"]
Oct 30 19:48:06.901977 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:48:06.901940    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fca59b7_1f91_4633_910e_688571b7abd3.slice/crio-001c05b198c1b5dfa51fd2273f7926518a0362865b0f4ab391b3fbc47b9ca904 WatchSource:0}: Error finding container 001c05b198c1b5dfa51fd2273f7926518a0362865b0f4ab391b3fbc47b9ca904: Status 404 returned error can't find the container with id 001c05b198c1b5dfa51fd2273f7926518a0362865b0f4ab391b3fbc47b9ca904
Oct 30 19:48:06.904910 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.904873    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:48:06.905030 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.904966    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:48:06.905030 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:06.905018    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:48:07.139555 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:07.139518    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" event={"ID":"0fca59b7-1f91-4633-910e-688571b7abd3","Type":"ContainerStarted","Data":"775d7f42f321286e8fe34b06f89159c958cc8e0b1f78e9c68c2308a6b5834a9a"}
Oct 30 19:48:07.139776 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:07.139579    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" event={"ID":"0fca59b7-1f91-4633-910e-688571b7abd3","Type":"ContainerStarted","Data":"001c05b198c1b5dfa51fd2273f7926518a0362865b0f4ab391b3fbc47b9ca904"}
Oct 30 19:48:07.256133 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:07.256011    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" podStartSLOduration=2.255990122 podStartE2EDuration="2.255990122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:48:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:48:07.255035807 +0000 UTC m=+1349.797843073" watchObservedRunningTime="2026-10-30 19:48:07.255990122 +0000 UTC m=+1349.798797388"
Oct 30 19:48:07.425313 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:07.425270    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:07.485833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:07.483209    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:07.499829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:07.491755    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 19:48:07.499829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:07.491876    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 19:48:08.485267 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:08.485228    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 19:48:08.485907 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:08.485869    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 19:48:08.850862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:08.850829    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:09.092945 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:09.092900    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj" podUID="480c838e-6da3-47c0-9bd5-a8154efaf2e7" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:48:09.325109 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:09.325013    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:09.475243 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:09.475207    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 19:48:09.475623 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:09.475593    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 19:48:09.496515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:09.496481    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:10.475833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:10.475258    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 19:48:10.475833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:10.475336    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 19:48:11.202995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:11.202954    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"]
Oct 30 19:48:11.249529 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:11.249492    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"]
Oct 30 19:48:11.250999 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:11.250970    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj" podUID="480c838e-6da3-47c0-9bd5-a8154efaf2e7" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:48:11.390936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:11.390900    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:11.476697 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:11.474245    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 19:48:11.476697 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:11.474314    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 19:48:12.486315 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:12.486268    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 19:48:12.486915 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:12.486882    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 19:48:12.910759 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:12.910722    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:13.472354 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:13.472317    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 19:48:13.472583 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:13.472384    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 19:48:14.475927 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:14.475890    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:14.476361 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:14.476280    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:14.477100 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:14.477082    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:48:16.204068 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.203951    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j" podUID="46b4e426-b79b-4e99-bf2e-232a1f74c668" containerName="payload-processing" containerID="cri-o://c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef" gracePeriod=25
Oct 30 19:48:16.250551 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.250501    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj" podUID="480c838e-6da3-47c0-9bd5-a8154efaf2e7" containerName="payload-processing" containerID="cri-o://4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f" gracePeriod=25
Oct 30 19:48:16.552198 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.552164    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:48:16.574459 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.574432    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:48:16.691863 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.691828    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-kube-api-access-55fz5\" (UniqueName: \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-kube-api-access-55fz5\") pod \"46b4e426-b79b-4e99-bf2e-232a1f74c668\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") "
Oct 30 19:48:16.692041 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.691901    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-plugins-config-volume\") pod \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") "
Oct 30 19:48:16.692041 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.691922    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-routing-overlay-volume\") pod \"46b4e426-b79b-4e99-bf2e-232a1f74c668\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") "
Oct 30 19:48:16.692041 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.691938    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-provider-credentials\" (UniqueName: \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-provider-credentials\") pod \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") "
Oct 30 19:48:16.692041 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.692015    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-kube-api-access-68h59\" (UniqueName: \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-kube-api-access-68h59\") pod \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") "
Oct 30 19:48:16.692286 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.692056    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-routing-overlay-volume\") pod \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\" (UID: \"480c838e-6da3-47c0-9bd5-a8154efaf2e7\") "
Oct 30 19:48:16.692286 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.692131    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-plugins-config-volume\") pod \"46b4e426-b79b-4e99-bf2e-232a1f74c668\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") "
Oct 30 19:48:16.692286 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.692221    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-provider-credentials\" (UniqueName: \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-provider-credentials\") pod \"46b4e426-b79b-4e99-bf2e-232a1f74c668\" (UID: \"46b4e426-b79b-4e99-bf2e-232a1f74c668\") "
Oct 30 19:48:16.693301 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.692777    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-routing-overlay-volume" pod "480c838e-6da3-47c0-9bd5-a8154efaf2e7" (UID: "480c838e-6da3-47c0-9bd5-a8154efaf2e7"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:48:16.693301 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.693265    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-plugins-config-volume" pod "46b4e426-b79b-4e99-bf2e-232a1f74c668" (UID: "46b4e426-b79b-4e99-bf2e-232a1f74c668"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:48:16.693301 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.693284    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-routing-overlay-volume" pod "46b4e426-b79b-4e99-bf2e-232a1f74c668" (UID: "46b4e426-b79b-4e99-bf2e-232a1f74c668"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:48:16.693711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.693691    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-plugins-config-volume" pod "480c838e-6da3-47c0-9bd5-a8154efaf2e7" (UID: "480c838e-6da3-47c0-9bd5-a8154efaf2e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:48:16.695437 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.695410    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-provider-credentials" pod "46b4e426-b79b-4e99-bf2e-232a1f74c668" (UID: "46b4e426-b79b-4e99-bf2e-232a1f74c668"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:48:16.695533 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.695452    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-provider-credentials" pod "480c838e-6da3-47c0-9bd5-a8154efaf2e7" (UID: "480c838e-6da3-47c0-9bd5-a8154efaf2e7"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:48:16.696414 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.696393    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-kube-api-access-68h59" pod "480c838e-6da3-47c0-9bd5-a8154efaf2e7" (UID: "480c838e-6da3-47c0-9bd5-a8154efaf2e7"). InnerVolumeSpecName "kube-api-access-68h59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:48:16.696499 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.696413    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-kube-api-access-55fz5" pod "46b4e426-b79b-4e99-bf2e-232a1f74c668" (UID: "46b4e426-b79b-4e99-bf2e-232a1f74c668"). InnerVolumeSpecName "kube-api-access-55fz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:48:16.793561 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.793535    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:48:16.793561 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.793565    6015 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-routing-overlay-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:48:16.793862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.793578    6015 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-provider-credentials\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:48:16.793862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.793591    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68h59\" (UniqueName: \"kubernetes.io/projected/480c838e-6da3-47c0-9bd5-a8154efaf2e7-kube-api-access-68h59\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:48:16.793862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.793603    6015 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/480c838e-6da3-47c0-9bd5-a8154efaf2e7-routing-overlay-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:48:16.793862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.793615    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46b4e426-b79b-4e99-bf2e-232a1f74c668-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:48:16.793862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.793628    6015 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-provider-credentials\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:48:16.793862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:16.793641    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55fz5\" (UniqueName: \"kubernetes.io/projected/46b4e426-b79b-4e99-bf2e-232a1f74c668-kube-api-access-55fz5\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:48:17.239914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.239882    6015 generic.go:356] "Generic (PLEG): container finished" podID="46b4e426-b79b-4e99-bf2e-232a1f74c668" containerID="c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef" exitCode=0
Oct 30 19:48:17.240378 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.239926    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"
Oct 30 19:48:17.240378 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.239925    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j" event={"ID":"46b4e426-b79b-4e99-bf2e-232a1f74c668","Type":"ContainerDied","Data":"c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef"}
Oct 30 19:48:17.240378 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.239988    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-596cf5558c-jj48j" event={"ID":"46b4e426-b79b-4e99-bf2e-232a1f74c668","Type":"ContainerDied","Data":"640e75f0518ccfd46813d9ccc191902571a3a01de68d1a614b2ab432ffb5fe54"}
Oct 30 19:48:17.240378 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.240004    6015 scope.go:122] "RemoveContainer" containerID="c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef"
Oct 30 19:48:17.241743 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.241673    6015 generic.go:356] "Generic (PLEG): container finished" podID="480c838e-6da3-47c0-9bd5-a8154efaf2e7" containerID="4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f" exitCode=0
Oct 30 19:48:17.241743 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.241713    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj" event={"ID":"480c838e-6da3-47c0-9bd5-a8154efaf2e7","Type":"ContainerDied","Data":"4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f"}
Oct 30 19:48:17.241743 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.241732    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"
Oct 30 19:48:17.241743 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.241747    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj" event={"ID":"480c838e-6da3-47c0-9bd5-a8154efaf2e7","Type":"ContainerDied","Data":"9d1e50cb6aa86a0599e8e35f49f8758b110c6e8e0710898d3d24870c3af3dbdf"}
Oct 30 19:48:17.251380 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.251090    6015 scope.go:122] "RemoveContainer" containerID="c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef"
Oct 30 19:48:17.254753 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:48:17.254584    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef\": container with ID starting with c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef not found: ID does not exist" containerID="c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef"
Oct 30 19:48:17.254753 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.254629    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef"} err="failed to get container status \"c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef\": rpc error: code = NotFound desc = could not find container \"c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef\": container with ID starting with c5aa44478ab731cca538b05e86dd12ba23b89b45fc03e7a04af71757cd5fc1ef not found: ID does not exist"
Oct 30 19:48:17.254753 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.254655    6015 scope.go:122] "RemoveContainer" containerID="4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f"
Oct 30 19:48:17.264893 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.264875    6015 scope.go:122] "RemoveContainer" containerID="4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f"
Oct 30 19:48:17.265190 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:48:17.265168    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f\": container with ID starting with 4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f not found: ID does not exist" containerID="4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f"
Oct 30 19:48:17.265236 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.265198    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f"} err="failed to get container status \"4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f\": rpc error: code = NotFound desc = could not find container \"4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f\": container with ID starting with 4191df515840d20ff2df2221293779543036527b4e39354e033cea7e2ab4619f not found: ID does not exist"
Oct 30 19:48:17.412769 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.412727    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"]
Oct 30 19:48:17.415458 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.415433    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-7f9f45fffd-z2xgj"]
Oct 30 19:48:17.533039 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.532959    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"]
Oct 30 19:48:17.538415 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.538386    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-596cf5558c-jj48j"]
Oct 30 19:48:17.587463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.587423    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46b4e426-b79b-4e99-bf2e-232a1f74c668" path="/var/lib/kubelet/pods/46b4e426-b79b-4e99-bf2e-232a1f74c668/volumes"
Oct 30 19:48:17.587988 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:17.587965    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="480c838e-6da3-47c0-9bd5-a8154efaf2e7" path="/var/lib/kubelet/pods/480c838e-6da3-47c0-9bd5-a8154efaf2e7/volumes"
Oct 30 19:48:18.066831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:18.066657    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:18.961835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:18.960944    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6ns9w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 19:48:18.961835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:18.961053    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:19.524839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:19.524381    6015 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:19.524839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:19.524705    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" podUID="032b436b-bd82-4e71-a709-c58ce8cbf72e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 19:48:19.754959 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:19.752958    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:19.796835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:19.793997    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:20.046832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:20.045362    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn" podUID="23b6d445-7b28-4f9f-aecc-874ff146099e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:20.127895 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:20.123933    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" podUID="6c4a770e-321c-4c47-93dc-2ebff03fb985" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:20.255340 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:20.255285    6015 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:20.407897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:20.394527    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:20.530871 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:20.529935    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" podUID="032b436b-bd82-4e71-a709-c58ce8cbf72e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:20.536868 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:20.531492    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:48:20.765895 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:20.753847    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:20.797847 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:20.785578    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:48:20.811836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:20.800421    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:20.812227 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:20.812198    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:48:21.056895 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.047081    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn" podUID="23b6d445-7b28-4f9f-aecc-874ff146099e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:21.056895 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.047629    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:48:21.150836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.149902    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" podUID="6c4a770e-321c-4c47-93dc-2ebff03fb985" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:21.150836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.150674    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:48:21.213835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.212000    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 19:48:21.213835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.212105    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:21.415896 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.400915    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded"
Oct 30 19:48:21.415896 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.402171    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:48:21.576839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.573685    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" podUID="032b436b-bd82-4e71-a709-c58ce8cbf72e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 19:48:21.799969 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.785039    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:21.803351 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.803231    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:21.952410 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:21.951060    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:48:22.165392 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:22.165263    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" podUID="6c4a770e-321c-4c47-93dc-2ebff03fb985" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:22.342215 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:22.342169    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:48:22.409194 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:22.407985    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded"
Oct 30 19:48:22.617635 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:22.617576    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" podUID="032b436b-bd82-4e71-a709-c58ce8cbf72e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 19:48:22.792829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:22.791972    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:23.002898 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:23.000671    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn" podUID="23b6d445-7b28-4f9f-aecc-874ff146099e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:23.154229 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:23.154199    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:48:23.254494 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:23.254393    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:48:23.412599 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:23.411424    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:23.482998 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:23.480213    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:48:23.680771 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:23.680737    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:48:25.721582 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:25.721546    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:25.947203 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:25.947165    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:26.128638 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:26.128602    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:28.215719 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:48:28.215684    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:48:30.809002 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:30.808970    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:36.019048 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:36.019002    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:36.881111 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:36.881072    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:37.200382 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:37.200291    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:41.406516 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:41.406475    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:46.321742 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:46.321702    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:46.749759 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:46.749680    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:50.226666 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:50.226623    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:50.401505 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:50.401462    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:50.666060 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:50.666018    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:51.263152 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.263117    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"]
Oct 30 19:48:51.263727 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.263710    6015 cpu_manager.go:414] "containerMap: removing container" podUID="46b4e426-b79b-4e99-bf2e-232a1f74c668" containerName="payload-processing"
Oct 30 19:48:51.263727 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.263727    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46b4e426-b79b-4e99-bf2e-232a1f74c668" containerName="payload-processing"
Oct 30 19:48:51.263896 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.263754    6015 cpu_manager.go:414] "containerMap: removing container" podUID="480c838e-6da3-47c0-9bd5-a8154efaf2e7" containerName="payload-processing"
Oct 30 19:48:51.263896 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.263760    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="480c838e-6da3-47c0-9bd5-a8154efaf2e7" containerName="payload-processing"
Oct 30 19:48:51.263896 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.263867    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="46b4e426-b79b-4e99-bf2e-232a1f74c668" containerName="payload-processing"
Oct 30 19:48:51.263896 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.263881    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="480c838e-6da3-47c0-9bd5-a8154efaf2e7" containerName="payload-processing"
Oct 30 19:48:51.267078 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.267058    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.368041 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.368004    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.368246 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.368164    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.368246 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.368213    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmww4\" (UniqueName: \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-kube-api-access-fmww4\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.368369 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.368302    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.368423 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.368388    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.368476 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.368457    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.368548 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.368528    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.368795 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.368764    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.368921 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.368821    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.370979 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.370953    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"]
Oct 30 19:48:51.470268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.470220    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.470517 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.470331    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.470517 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.470398    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.470517 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.470449    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.470709 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.470594    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.470709 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.470660    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.470835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.470741    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.470835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.470772    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.470957 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.470780    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmww4\" (UniqueName: \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-kube-api-access-fmww4\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.471012 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.471000    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.471065 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.471011    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.471065 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.471030    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.471372 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.471348    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.471548 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.471528    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.473685 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.473657    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.474131 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.474106    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.529107 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.529032    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.529244 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.529146    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmww4\" (UniqueName: \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-kube-api-access-fmww4\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.580296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.580259    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:51.710877 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.710843    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:51.900331 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:51.900284    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:52.024974 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:52.024938    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"]
Oct 30 19:48:52.026526 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:48:52.026496    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ff0b74_8ca4_4b0d_a453_f86fe5a240a2.slice/crio-1a61ba8297dad4c66295ad3969d335363bd742ce81203f6727133611d9a82033 WatchSource:0}: Error finding container 1a61ba8297dad4c66295ad3969d335363bd742ce81203f6727133611d9a82033: Status 404 returned error can't find the container with id 1a61ba8297dad4c66295ad3969d335363bd742ce81203f6727133611d9a82033
Oct 30 19:48:52.028951 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:52.028916    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:48:52.029041 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:52.028986    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:48:52.029041 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:52.029015    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:48:52.073657 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:52.073188    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:52.914369 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:52.914329    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" event={"ID":"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2","Type":"ContainerStarted","Data":"a8baca38efab4a59c148d3311d99d2ed67157b0c373ef03156f13967c6c3c938"}
Oct 30 19:48:52.914768 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:52.914394    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" event={"ID":"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2","Type":"ContainerStarted","Data":"1a61ba8297dad4c66295ad3969d335363bd742ce81203f6727133611d9a82033"}
Oct 30 19:48:53.029619 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:53.029559    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" podStartSLOduration=2.029543726 podStartE2EDuration="2.029543726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:48:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:48:53.028626427 +0000 UTC m=+1395.571433692" watchObservedRunningTime="2026-10-30 19:48:53.029543726 +0000 UTC m=+1395.572351021"
Oct 30 19:48:53.603835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:53.588972    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 19:48:53.603835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:53.589051    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 19:48:53.609465 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:53.609437    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:48:54.584220 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:54.584182    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 19:48:54.584865 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:54.584831    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 19:48:55.585943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:55.585898    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 19:48:55.586479 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:55.585978    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 19:48:56.583232 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:56.583192    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 19:48:56.583529 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:56.583501    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 19:48:57.022518 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:57.022427    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:57.612974 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:57.612938    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 19:48:57.613303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:57.613270    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 19:48:58.374167 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:48:58.366726    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:48:58.465833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:58.460026    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:48:58.592844 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:58.592229    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 19:48:58.592844 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:58.592288    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 19:48:58.752012 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:58.751916    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:48:59.581666 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:59.581628    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 30 19:48:59.582303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:59.581690    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 30 19:48:59.986561 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:59.986477    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"]
Oct 30 19:48:59.990555 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:48:59.990526    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.048593 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.048559    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4ec609\"/\"openshift-service-ca.crt\""
Oct 30 19:49:00.078382 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.078340    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"]
Oct 30 19:49:00.085017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.084988    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-model-cache\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.085176 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.085049    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw7zd\" (UniqueName: \"kubernetes.io/projected/179f17ce-6608-4f79-9c5a-e675719d5bef-kube-api-access-mw7zd\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.085176 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.085150    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-home\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.085334 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.085316    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/179f17ce-6608-4f79-9c5a-e675719d5bef-tls-certs\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.085400 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.085372    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-tmp-dir\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.085551 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.085523    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-dshm\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.089414 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.089390    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4ec609\"/\"kube-root-ca.crt\""
Oct 30 19:49:00.089538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.089401    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4ec609\"/\"default-dockercfg-krcrx\""
Oct 30 19:49:00.089538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.089390    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4ec609\"/\"distinct-w4-4ec609-kserve-self-signed-certs\""
Oct 30 19:49:00.093743 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.093708    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:00.187472 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.187423    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-tmp-dir\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.187741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.187549    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-dshm\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.187741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.187634    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-model-cache\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.187741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.187692    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw7zd\" (UniqueName: \"kubernetes.io/projected/179f17ce-6608-4f79-9c5a-e675719d5bef-kube-api-access-mw7zd\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.187741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.187723    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-home\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.188044 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.187892    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/179f17ce-6608-4f79-9c5a-e675719d5bef-tls-certs\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.188044 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.188007    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-tmp-dir\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.188164 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.188051    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-model-cache\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.188289 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.188268    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-home\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.190471 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.190446    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-dshm\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.190938 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.190916    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/179f17ce-6608-4f79-9c5a-e675719d5bef-tls-certs\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.249511 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.249423    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw7zd\" (UniqueName: \"kubernetes.io/projected/179f17ce-6608-4f79-9c5a-e675719d5bef-kube-api-access-mw7zd\") pod \"distinct-w4-4ec609-kserve-f6495f8cb-84rgx\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.307038 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.306997    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:00.707512 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:00.707479    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"]
Oct 30 19:49:00.710197 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:49:00.710164    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod179f17ce_6608_4f79_9c5a_e675719d5bef.slice/crio-18f88eba3d3a2af84d7e6601ca4cd732d075cb4e56db922e135e63d2d65b7d9a WatchSource:0}: Error finding container 18f88eba3d3a2af84d7e6601ca4cd732d075cb4e56db922e135e63d2d65b7d9a: Status 404 returned error can't find the container with id 18f88eba3d3a2af84d7e6601ca4cd732d075cb4e56db922e135e63d2d65b7d9a
Oct 30 19:49:01.036496 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:01.036402    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx" event={"ID":"179f17ce-6608-4f79-9c5a-e675719d5bef","Type":"ContainerStarted","Data":"99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568"}
Oct 30 19:49:01.036496 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:01.036453    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx" event={"ID":"179f17ce-6608-4f79-9c5a-e675719d5bef","Type":"ContainerStarted","Data":"18f88eba3d3a2af84d7e6601ca4cd732d075cb4e56db922e135e63d2d65b7d9a"}
Oct 30 19:49:01.148990 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:01.148936    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx" podStartSLOduration=2.148897766 podStartE2EDuration="2.148897766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:48:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:49:01.147717407 +0000 UTC m=+1403.690524673" watchObservedRunningTime="2026-10-30 19:49:01.148897766 +0000 UTC m=+1403.691705032"
Oct 30 19:49:01.307869 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:01.307800    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:01.474356 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:01.474325    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:49:01.474726 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:01.474656    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:49:01.476026 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:01.476002    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:49:02.517488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:02.517442    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:06.046392 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:06.046343    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:07.711023 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:07.710990    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:09.847767 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:09.847730    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:10.307388 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:10.307343    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:10.320432 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:10.320403    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:11.120586 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:11.120558    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:12.807744 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:12.807712    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:16.201574 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:16.201533    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:17.909861 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:17.909787    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:22.912867 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:22.912825    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:28.341689 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:28.341641    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:49:28.577836 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:49:28.569065    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:49:28.593042 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:28.592931    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" podUID="032b436b-bd82-4e71-a709-c58ce8cbf72e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 19:49:28.832009 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:28.831951    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:49:28.942892 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:28.942007    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:28.990405 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:28.990355    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn" podUID="23b6d445-7b28-4f9f-aecc-874ff146099e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": context deadline exceeded"
Oct 30 19:49:29.136833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.135911    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx" podUID="179f17ce-6608-4f79-9c5a-e675719d5bef" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:49:29.166949 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.166900    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" podUID="6c4a770e-321c-4c47-93dc-2ebff03fb985" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:49:29.423832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.421126    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded"
Oct 30 19:49:29.423832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.422690    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Oct 30 19:49:29.502347 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.500901    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:49:29.528852 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.528333    6015 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/health\": context deadline exceeded"
Oct 30 19:49:29.609918 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.593397    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" podUID="032b436b-bd82-4e71-a709-c58ce8cbf72e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.60:8000/ready\": context deadline exceeded"
Oct 30 19:49:29.836951 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.836901    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:49:29.944833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.944515    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:49:29.944833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.944588    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:49:29.998488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.990777    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn" podUID="23b6d445-7b28-4f9f-aecc-874ff146099e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:49:29.998488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:29.991427    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:49:30.149137 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.136115    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx" podUID="179f17ce-6608-4f79-9c5a-e675719d5bef" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:49:30.173955 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.173911    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:30.238829 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.191763    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" podUID="6c4a770e-321c-4c47-93dc-2ebff03fb985" containerName="main" probeResult="failure" output="Get \"https://10.134.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:49:30.267630 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.267161    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:49:30.378862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.342104    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 19:49:30.421872 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.421755    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:49:30.452325 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.452291    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:49:30.475574 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.468887    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Oct 30 19:49:30.509135 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.509105    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 19:49:30.615868 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.615826    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 19:49:30.646338 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.646305    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 19:49:30.738889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.728840    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 19:49:30.742798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.742763    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 19:49:30.752514 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:30.752490    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 19:49:32.844694 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.844658    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"]
Oct 30 19:49:32.849193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.849168    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.859069 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.859037    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-home\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.859200 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.859099    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-tmp-dir\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.859563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.859531    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d132ed73-6a9c-4be9-8682-ec854f7b5300-tls-certs\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.859684 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.859611    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7llnx\" (UniqueName: \"kubernetes.io/projected/d132ed73-6a9c-4be9-8682-ec854f7b5300-kube-api-access-7llnx\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.859916 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.859834    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-model-cache\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.859916 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.859884    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-dshm\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.937334 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.937299    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:32.945898 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.945871    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"]
Oct 30 19:49:32.947323 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.947305    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4ec609\"/\"distinct-2-w4-4ec609-kserve-self-signed-certs\""
Oct 30 19:49:32.961097 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.961068    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-model-cache\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.961239 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.961108    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-dshm\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.961239 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.961142    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-home\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.961239 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.961182    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-tmp-dir\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.961411 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.961297    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d132ed73-6a9c-4be9-8682-ec854f7b5300-tls-certs\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.961411 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.961337    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llnx\" (UniqueName: \"kubernetes.io/projected/d132ed73-6a9c-4be9-8682-ec854f7b5300-kube-api-access-7llnx\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.961589 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.961571    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-model-cache\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.961669 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.961625    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-home\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.961713 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.961657    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-tmp-dir\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.963587 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.963565    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-dshm\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:32.963950 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:32.963931    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d132ed73-6a9c-4be9-8682-ec854f7b5300-tls-certs\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:33.019447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:33.019413    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7llnx\" (UniqueName: \"kubernetes.io/projected/d132ed73-6a9c-4be9-8682-ec854f7b5300-kube-api-access-7llnx\") pod \"distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") " pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:33.162575 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:33.162481    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:33.551928 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:33.551106    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"]
Oct 30 19:49:33.553062 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:49:33.553033    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd132ed73_6a9c_4be9_8682_ec854f7b5300.slice/crio-f2844ceeff6863f6bd39c768bd8c3d1683f08d4cece36e5edb0d3c0d019f3707 WatchSource:0}: Error finding container f2844ceeff6863f6bd39c768bd8c3d1683f08d4cece36e5edb0d3c0d019f3707: Status 404 returned error can't find the container with id f2844ceeff6863f6bd39c768bd8c3d1683f08d4cece36e5edb0d3c0d019f3707
Oct 30 19:49:34.563206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:34.563168    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd" event={"ID":"d132ed73-6a9c-4be9-8682-ec854f7b5300","Type":"ContainerStarted","Data":"79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7"}
Oct 30 19:49:34.563206 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:34.563210    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd" event={"ID":"d132ed73-6a9c-4be9-8682-ec854f7b5300","Type":"ContainerStarted","Data":"f2844ceeff6863f6bd39c768bd8c3d1683f08d4cece36e5edb0d3c0d019f3707"}
Oct 30 19:49:34.678086 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:34.678026    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd" podStartSLOduration=2.678002803 podStartE2EDuration="2.678002803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:49:34.674898556 +0000 UTC m=+1437.217705822" watchObservedRunningTime="2026-10-30 19:49:34.678002803 +0000 UTC m=+1437.220810069"
Oct 30 19:49:34.711752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:34.711718    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:35.163050 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:35.163018    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:39.886127 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:39.883598    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:43.163265 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:43.163229    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:43.176377 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:43.176352    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:43.647335 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:43.647305    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 19:49:44.981664 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:44.981608    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:46.652619 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:46.652532    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:47.600578 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.600538    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"]
Oct 30 19:49:47.605288 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.605261    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.655218 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.655174    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-4ec609-openshift-default-dockercfg-4txpk\""
Oct 30 19:49:47.706025 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.705988    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"]
Oct 30 19:49:47.754119 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.754086    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-socket\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.754119 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.754119    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-envoy\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.754413 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.754139    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz8dp\" (UniqueName: \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-kube-api-access-cz8dp\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.754413 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.754240    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-data\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.754413 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.754270    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-certs\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.754413 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.754305    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-token\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.754413 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.754333    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-credential-socket\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.754413 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.754390    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-podinfo\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.754846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.754456    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istiod-ca-cert\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.856337 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.856232    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-podinfo\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.856522 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.856347    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istiod-ca-cert\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.856522 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.856472    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-socket\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.856522 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.856495    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-envoy\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.856695 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.856520    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz8dp\" (UniqueName: \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-kube-api-access-cz8dp\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.856695 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.856583    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-data\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.856695 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.856621    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-certs\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.856695 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.856656    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-token\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.856695 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.856689    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-credential-socket\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.856966 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.856910    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-socket\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.857169 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.857140    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-data\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.857169 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.857156    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-credential-socket\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.857286 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.857212    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istiod-ca-cert\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.857286 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.857228    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-certs\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.858978 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.858957    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-envoy\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.859403 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.859382    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-podinfo\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.915445 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.915406    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-token\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.915622 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.915588    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz8dp\" (UniqueName: \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-kube-api-access-cz8dp\") pod \"e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") " pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:47.920442 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:47.920415    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:48.261478 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:48.261381    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:48.346871 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:48.346839    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"]
Oct 30 19:49:48.348503 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:49:48.348473    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9d69e8_4d02_4d58_ae67_67d545aceffa.slice/crio-3ee99ecf76c1d53f71e2ce83378201a8e21681e8b0face53fda983f964f732ac WatchSource:0}: Error finding container 3ee99ecf76c1d53f71e2ce83378201a8e21681e8b0face53fda983f964f732ac: Status 404 returned error can't find the container with id 3ee99ecf76c1d53f71e2ce83378201a8e21681e8b0face53fda983f964f732ac
Oct 30 19:49:48.351129 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:48.351092    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:49:48.351250 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:48.351175    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:49:48.351250 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:48.351226    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:49:48.682765 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:48.682733    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" event={"ID":"1e9d69e8-4d02-4d58-ae67-67d545aceffa","Type":"ContainerStarted","Data":"1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c"}
Oct 30 19:49:48.683189 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:48.682784    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" event={"ID":"1e9d69e8-4d02-4d58-ae67-67d545aceffa","Type":"ContainerStarted","Data":"3ee99ecf76c1d53f71e2ce83378201a8e21681e8b0face53fda983f964f732ac"}
Oct 30 19:49:48.805955 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:48.805897    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" podStartSLOduration=1.80587922 podStartE2EDuration="1.80587922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:49:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:49:48.804077902 +0000 UTC m=+1451.346885171" watchObservedRunningTime="2026-10-30 19:49:48.80587922 +0000 UTC m=+1451.348686488"
Oct 30 19:49:48.920969 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:48.920920    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:49.737849 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:49.737786    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:49.922569 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:49.922535    6015 patch_prober.go:29] interesting pod/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 19:49:49.922751 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:49.922586    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 19:49:50.138048 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:50.138001    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:50.921596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:50.921548    6015 patch_prober.go:29] interesting pod/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 19:49:50.922107 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:50.921616    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 19:49:51.921839 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:51.921762    6015 patch_prober.go:29] interesting pod/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 19:49:51.922266 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:51.921858    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 19:49:52.921289 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:52.921250    6015 patch_prober.go:29] interesting pod/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 19:49:52.921467 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:52.921311    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 19:49:53.699102 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:53.699027    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:53.892832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:53.892379    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:53.921654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:53.921620    6015 patch_prober.go:29] interesting pod/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 19:49:53.921858 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:53.921678    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 19:49:54.046853 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:54.046800    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:54.209036 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:54.208998    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:54.480429 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:54.480329    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:54.921087 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:54.921044    6015 patch_prober.go:29] interesting pod/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Oct 30 19:49:54.921499 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:54.921141    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Oct 30 19:49:55.915640 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:55.915602    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:55.925293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:55.925266    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:55.925761 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:55.925738    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:55.926620 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:55.926600    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:49:57.018482 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.018438    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:57.204048 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.204000    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:49:57.435822 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.435775    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"]
Oct 30 19:49:57.440083 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.440062    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:49:57.499416 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.499376    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"]
Oct 30 19:49:57.555238 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.551019    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-8d3b6f\""
Oct 30 19:49:57.555238 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.551167    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-8d3b6f-dockercfg-zdwpx\""
Oct 30 19:49:57.588492 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.587189    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"]
Oct 30 19:49:57.594614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.594581    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:49:57.647832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.634295    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngxx5\" (UniqueName: \"kubernetes.io/projected/dc7d170e-cd97-44a3-841d-182cc6830678-kube-api-access-ngxx5\") pod \"payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb\" (UID: \"dc7d170e-cd97-44a3-841d-182cc6830678\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:49:57.647832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.634407    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd\" (UID: \"b2ff4d0d-5806-41cc-830e-04ee2ba3429c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:49:57.647832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.634472    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc7d170e-cd97-44a3-841d-182cc6830678-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb\" (UID: \"dc7d170e-cd97-44a3-841d-182cc6830678\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:49:57.647832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.634505    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mhmr\" (UniqueName: \"kubernetes.io/projected/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-kube-api-access-9mhmr\") pod \"payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd\" (UID: \"b2ff4d0d-5806-41cc-830e-04ee2ba3429c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:49:57.672148 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.672110    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"]
Oct 30 19:49:57.736050 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.735962    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngxx5\" (UniqueName: \"kubernetes.io/projected/dc7d170e-cd97-44a3-841d-182cc6830678-kube-api-access-ngxx5\") pod \"payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb\" (UID: \"dc7d170e-cd97-44a3-841d-182cc6830678\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:49:57.736050 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.736029    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd\" (UID: \"b2ff4d0d-5806-41cc-830e-04ee2ba3429c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:49:57.736289 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.736071    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc7d170e-cd97-44a3-841d-182cc6830678-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb\" (UID: \"dc7d170e-cd97-44a3-841d-182cc6830678\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:49:57.736289 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.736095    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mhmr\" (UniqueName: \"kubernetes.io/projected/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-kube-api-access-9mhmr\") pod \"payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd\" (UID: \"b2ff4d0d-5806-41cc-830e-04ee2ba3429c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:49:57.736873 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.736851    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc7d170e-cd97-44a3-841d-182cc6830678-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb\" (UID: \"dc7d170e-cd97-44a3-841d-182cc6830678\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:49:57.736933 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.736874    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd\" (UID: \"b2ff4d0d-5806-41cc-830e-04ee2ba3429c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:49:57.795054 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.795025    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mhmr\" (UniqueName: \"kubernetes.io/projected/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-kube-api-access-9mhmr\") pod \"payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd\" (UID: \"b2ff4d0d-5806-41cc-830e-04ee2ba3429c\") " pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:49:57.795208 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.795030    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngxx5\" (UniqueName: \"kubernetes.io/projected/dc7d170e-cd97-44a3-841d-182cc6830678-kube-api-access-ngxx5\") pod \"payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb\" (UID: \"dc7d170e-cd97-44a3-841d-182cc6830678\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:49:57.988283 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:57.988188    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:49:58.056135 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:58.056093    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:49:58.225047 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:49:58.225008    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:49:58.364036 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:58.363981    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"]
Oct 30 19:49:58.365533 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:49:58.365494    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ff4d0d_5806_41cc_830e_04ee2ba3429c.slice/crio-88339d28b6c6788537cedcca6f0ff63ee99578eb7e219a17be44112ecd5f1ab8 WatchSource:0}: Error finding container 88339d28b6c6788537cedcca6f0ff63ee99578eb7e219a17be44112ecd5f1ab8: Status 404 returned error can't find the container with id 88339d28b6c6788537cedcca6f0ff63ee99578eb7e219a17be44112ecd5f1ab8
Oct 30 19:49:58.458577 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:58.458546    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"]
Oct 30 19:49:58.460951 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:49:58.460923    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7d170e_cd97_44a3_841d_182cc6830678.slice/crio-f3307b4b112a4f864913d9a2caf061d976925755a5b4ad8b589c5a4d37e8e1fa WatchSource:0}: Error finding container f3307b4b112a4f864913d9a2caf061d976925755a5b4ad8b589c5a4d37e8e1fa: Status 404 returned error can't find the container with id f3307b4b112a4f864913d9a2caf061d976925755a5b4ad8b589c5a4d37e8e1fa
Oct 30 19:49:58.775607 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:58.775503    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd" event={"ID":"b2ff4d0d-5806-41cc-830e-04ee2ba3429c","Type":"ContainerStarted","Data":"7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977"}
Oct 30 19:49:58.775607 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:58.775569    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd" event={"ID":"b2ff4d0d-5806-41cc-830e-04ee2ba3429c","Type":"ContainerStarted","Data":"88339d28b6c6788537cedcca6f0ff63ee99578eb7e219a17be44112ecd5f1ab8"}
Oct 30 19:49:58.775798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:58.775787    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:49:58.777612 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:58.777581    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb" event={"ID":"dc7d170e-cd97-44a3-841d-182cc6830678","Type":"ContainerStarted","Data":"7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7"}
Oct 30 19:49:58.777772 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:58.777634    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb" event={"ID":"dc7d170e-cd97-44a3-841d-182cc6830678","Type":"ContainerStarted","Data":"f3307b4b112a4f864913d9a2caf061d976925755a5b4ad8b589c5a4d37e8e1fa"}
Oct 30 19:49:58.777772 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:58.777684    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:49:58.886125 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:58.885953    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd" podStartSLOduration=1.885934201 podStartE2EDuration="1.885934201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:49:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:49:58.885210654 +0000 UTC m=+1461.428017957" watchObservedRunningTime="2026-10-30 19:49:58.885934201 +0000 UTC m=+1461.428741463"
Oct 30 19:49:58.998072 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:49:58.998015    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb" podStartSLOduration=1.997996578 podStartE2EDuration="1.997996578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:49:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:49:58.995388407 +0000 UTC m=+1461.538195674" watchObservedRunningTime="2026-10-30 19:49:58.997996578 +0000 UTC m=+1461.540803844"
Oct 30 19:50:01.110899 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:01.110854    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:01.265980 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:01.265938    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:06.333472 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:06.333432    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:09.789162 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:09.789130    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:50:09.789642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:09.789215    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:50:11.436471 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:11.436429    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:16.437470 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:16.437429    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:21.478455 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:21.478398    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:26.140402 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.140355    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"]
Oct 30 19:50:26.144712 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.144692    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.196878 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.196835    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-8d3b6f-serving-cert\""
Oct 30 19:50:26.230907 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.230875    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-openshift-service-ca\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.231081 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.230915    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-maas-api-tls\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.231081 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.230951    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-metrics-certs\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.231081 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.230986    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmm8c\" (UniqueName: \"kubernetes.io/projected/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-kube-api-access-jmm8c\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.246344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.246311    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"]
Oct 30 19:50:26.332826 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.332771    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-openshift-service-ca\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.333035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.332834    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-maas-api-tls\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.333035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.332871    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-metrics-certs\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.333035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.332892    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmm8c\" (UniqueName: \"kubernetes.io/projected/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-kube-api-access-jmm8c\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.333035 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:50:26.332944    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-serving-cert: secret "maas-api-e2e-api-a-8d3b6f-serving-cert" not found
Oct 30 19:50:26.333236 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:50:26.333055    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-maas-api-tls podName:5c8770f9-b6b3-4db7-ba7d-66406bd7c936 nodeName:}" failed. No retries permitted until 2026-10-30 19:50:26.833031537 +0000 UTC m=+1489.375838803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-maas-api-tls") pod "maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4" (UID: "5c8770f9-b6b3-4db7-ba7d-66406bd7c936") : secret "maas-api-e2e-api-a-8d3b6f-serving-cert" not found
Oct 30 19:50:26.333563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.333540    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-openshift-service-ca\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.335559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.335538    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-metrics-certs\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.354555 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.354516    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:26.391728 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.391660    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmm8c\" (UniqueName: \"kubernetes.io/projected/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-kube-api-access-jmm8c\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.599140 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.599101    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:26.753635 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.753503    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:26.840491 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.840455    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-maas-api-tls\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:26.843296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:26.843261    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-maas-api-tls\") pod \"maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:27.059453 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:27.059405    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:27.454120 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:27.454003    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"]
Oct 30 19:50:27.456005 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:50:27.455981    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8770f9_b6b3_4db7_ba7d_66406bd7c936.slice/crio-93e64afceff3a139c27aebe9aff06ec8a07a4f8b89bdbfd4bfd4398dce363ac2 WatchSource:0}: Error finding container 93e64afceff3a139c27aebe9aff06ec8a07a4f8b89bdbfd4bfd4398dce363ac2: Status 404 returned error can't find the container with id 93e64afceff3a139c27aebe9aff06ec8a07a4f8b89bdbfd4bfd4398dce363ac2
Oct 30 19:50:27.458026 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:27.458005    6015 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 19:50:27.976175 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:27.976134    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4" event={"ID":"5c8770f9-b6b3-4db7-ba7d-66406bd7c936","Type":"ContainerStarted","Data":"93e64afceff3a139c27aebe9aff06ec8a07a4f8b89bdbfd4bfd4398dce363ac2"}
Oct 30 19:50:28.226684 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:50:28.226529    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:50:28.986899 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:28.986854    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4" event={"ID":"5c8770f9-b6b3-4db7-ba7d-66406bd7c936","Type":"ContainerStarted","Data":"f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060"}
Oct 30 19:50:28.987408 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:28.986927    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:29.103194 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:29.103138    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4" podStartSLOduration=2.1526946750000002 podStartE2EDuration="3.10312107s" totalImagesPullingTime="950.426395ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:50:29.10184355 +0000 UTC m=+1491.644650807" watchObservedRunningTime="2026-10-30 19:50:29.10312107 +0000 UTC m=+1491.645928335"
Oct 30 19:50:29.224332 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:29.224279    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:29.896854 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:29.894840    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:30.204939 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:30.204838    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:31.625654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:31.625621    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:33.901777 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:33.901738    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:34.069670 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:34.069635    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:34.226091 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:34.226004    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:35.013049 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:35.013018    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:50:37.180900 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:37.180857    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:38.001681 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:38.001639    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:38.201457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:38.201411    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:42.726212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:42.726175    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:47.044166 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:47.044119    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:47.815179 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:47.815133    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:51.348218 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:51.348179    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:52.904552 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:52.904505    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:54.738035 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:54.737998    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:55.405118 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:55.404952    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:55.929137 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:55.929099    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:57.594109 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:57.594076    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:58.032491 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:50:58.032408    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:50:58.216076 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:50:58.216030    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:51:00.377894 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:00.377853    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:00.581151 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:00.581113    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:03.404488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:03.404451    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:03.690438 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:03.690336    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:03.903179 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:03.903140    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:04.441136 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.441100    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"]
Oct 30 19:51:04.445873 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.445851    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:51:04.496511 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.496060    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-111f9c64\""
Oct 30 19:51:04.542575 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.542533    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-111f9c64-dockercfg-xkc7k\""
Oct 30 19:51:04.546110 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.546086    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"]
Oct 30 19:51:04.580058 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.580024    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r44qn\" (UniqueName: \"kubernetes.io/projected/2d1dc762-cde5-4a68-9572-145675e60f8b-kube-api-access-r44qn\") pod \"payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn\" (UID: \"2d1dc762-cde5-4a68-9572-145675e60f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:51:04.580271 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.580091    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d1dc762-cde5-4a68-9572-145675e60f8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn\" (UID: \"2d1dc762-cde5-4a68-9572-145675e60f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:51:04.681306 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.681273    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r44qn\" (UniqueName: \"kubernetes.io/projected/2d1dc762-cde5-4a68-9572-145675e60f8b-kube-api-access-r44qn\") pod \"payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn\" (UID: \"2d1dc762-cde5-4a68-9572-145675e60f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:51:04.681515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.681385    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d1dc762-cde5-4a68-9572-145675e60f8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn\" (UID: \"2d1dc762-cde5-4a68-9572-145675e60f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:51:04.682177 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.682153    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d1dc762-cde5-4a68-9572-145675e60f8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn\" (UID: \"2d1dc762-cde5-4a68-9572-145675e60f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:51:04.740793 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.740719    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r44qn\" (UniqueName: \"kubernetes.io/projected/2d1dc762-cde5-4a68-9572-145675e60f8b-kube-api-access-r44qn\") pod \"payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn\" (UID: \"2d1dc762-cde5-4a68-9572-145675e60f8b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:51:04.760661 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:04.760627    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:51:05.140435 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:05.140403    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"]
Oct 30 19:51:05.142607 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:51:05.142576    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1dc762_cde5_4a68_9572_145675e60f8b.slice/crio-415a8a5192c4d49ef94f8bf6898b2457ddc94bf4e27f79badf4d1a98ff192549 WatchSource:0}: Error finding container 415a8a5192c4d49ef94f8bf6898b2457ddc94bf4e27f79badf4d1a98ff192549: Status 404 returned error can't find the container with id 415a8a5192c4d49ef94f8bf6898b2457ddc94bf4e27f79badf4d1a98ff192549
Oct 30 19:51:05.250315 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:05.250267    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn" event={"ID":"2d1dc762-cde5-4a68-9572-145675e60f8b","Type":"ContainerStarted","Data":"db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a"}
Oct 30 19:51:05.250519 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:05.250334    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn" event={"ID":"2d1dc762-cde5-4a68-9572-145675e60f8b","Type":"ContainerStarted","Data":"415a8a5192c4d49ef94f8bf6898b2457ddc94bf4e27f79badf4d1a98ff192549"}
Oct 30 19:51:05.250519 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:05.250364    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:51:05.362184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:05.362122    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn" podStartSLOduration=1.36210364 podStartE2EDuration="1.36210364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:51:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:51:05.361741182 +0000 UTC m=+1527.904548448" watchObservedRunningTime="2026-10-30 19:51:05.36210364 +0000 UTC m=+1527.904910906"
Oct 30 19:51:08.696551 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:08.696508    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:09.996069 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:09.996029    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:10.774884 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:10.774846    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:11.427197 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:11.427164    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:11.692122 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:11.692022    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:11.840309 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:11.840271    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:12.293970 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:12.293908    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:14.235833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.235301    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"]
Oct 30 19:51:14.243837 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.241390    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.282834 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.280836    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7mch\" (UniqueName: \"kubernetes.io/projected/09422e2a-dfe9-42f3-8420-57fbbc15c0de-kube-api-access-c7mch\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.282834 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.280900    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.282834 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.281032    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09422e2a-dfe9-42f3-8420-57fbbc15c0de-openshift-service-ca\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.282834 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.281135    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-metrics-certs\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.315843 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.314318    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"]
Oct 30 19:51:14.340756 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.340723    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-cf283d-serving-cert\""
Oct 30 19:51:14.386222 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.386189    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-metrics-certs\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.395441 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.395399    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7mch\" (UniqueName: \"kubernetes.io/projected/09422e2a-dfe9-42f3-8420-57fbbc15c0de-kube-api-access-c7mch\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.395704 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.395684    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.426515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.426472    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09422e2a-dfe9-42f3-8420-57fbbc15c0de-openshift-service-ca\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.456255 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:51:14.410011    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-serving-cert: secret "maas-api-e2e-api-a-cf283d-serving-cert" not found
Oct 30 19:51:14.456255 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:51:14.433204    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls podName:09422e2a-dfe9-42f3-8420-57fbbc15c0de nodeName:}" failed. No retries permitted until 2026-10-30 19:51:14.933174174 +0000 UTC m=+1537.475981420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls") pod "maas-api-e2e-api-a-cf283d-f575f746b-r2p6p" (UID: "09422e2a-dfe9-42f3-8420-57fbbc15c0de") : secret "maas-api-e2e-api-a-cf283d-serving-cert" not found
Oct 30 19:51:14.458085 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.458056    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09422e2a-dfe9-42f3-8420-57fbbc15c0de-openshift-service-ca\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.493648 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.493561    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-metrics-certs\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.505830 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.503156    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:14.522873 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.521121    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7mch\" (UniqueName: \"kubernetes.io/projected/09422e2a-dfe9-42f3-8420-57fbbc15c0de-kube-api-access-c7mch\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.696381 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.696282    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:14.936304 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:14.936269    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:14.936512 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:51:14.936446    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-serving-cert: secret "maas-api-e2e-api-a-cf283d-serving-cert" not found
Oct 30 19:51:14.936588 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:51:14.936529    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls podName:09422e2a-dfe9-42f3-8420-57fbbc15c0de nodeName:}" failed. No retries permitted until 2026-10-30 19:51:15.936508402 +0000 UTC m=+1538.479315654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls") pod "maas-api-e2e-api-a-cf283d-f575f746b-r2p6p" (UID: "09422e2a-dfe9-42f3-8420-57fbbc15c0de") : secret "maas-api-e2e-api-a-cf283d-serving-cert" not found
Oct 30 19:51:15.516129 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:15.516090    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:15.714057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:15.714023    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:15.950990 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:15.950890    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:15.953520 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:15.953493    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls\") pod \"maas-api-e2e-api-a-cf283d-f575f746b-r2p6p\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:16.059098 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:16.059063    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:16.261277 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:16.261182    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:51:16.397954 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:16.397364    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:16.528623 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:16.528598    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"]
Oct 30 19:51:16.530564 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:51:16.530534    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09422e2a_dfe9_42f3_8420_57fbbc15c0de.slice/crio-867644ab9e9942aa97856e8d743e0491ab354697e32381a5851c1ec38bc6c401 WatchSource:0}: Error finding container 867644ab9e9942aa97856e8d743e0491ab354697e32381a5851c1ec38bc6c401: Status 404 returned error can't find the container with id 867644ab9e9942aa97856e8d743e0491ab354697e32381a5851c1ec38bc6c401
Oct 30 19:51:16.743406 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:16.743357    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:17.035832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:17.027987    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:17.181558 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:17.181516    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:17.407070 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:17.407035    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p" event={"ID":"09422e2a-dfe9-42f3-8420-57fbbc15c0de","Type":"ContainerStarted","Data":"867644ab9e9942aa97856e8d743e0491ab354697e32381a5851c1ec38bc6c401"}
Oct 30 19:51:18.420538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:18.420499    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p" event={"ID":"09422e2a-dfe9-42f3-8420-57fbbc15c0de","Type":"ContainerStarted","Data":"3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4"}
Oct 30 19:51:18.421107 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:18.420571    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:18.533526 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:18.533470    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p" podStartSLOduration=3.497342531 podStartE2EDuration="4.533454694s" totalImagesPullingTime="1.036112163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:51:18.532200736 +0000 UTC m=+1541.075008003" watchObservedRunningTime="2026-10-30 19:51:18.533454694 +0000 UTC m=+1541.076261969"
Oct 30 19:51:20.026730 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:20.026694    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:20.231468 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:20.231432    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:20.718831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:20.702381    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:22.575726 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:22.575685    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:22.773650 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:22.773610    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:22.943284 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:22.943201    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:24.434534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:24.434508    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:51:25.580739 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:25.580702    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:26.268086 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:26.268039    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:27.525001 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:27.524962    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:27.722635 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:27.722599    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:28.069902 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.069867    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"]
Oct 30 19:51:28.074143 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.074119    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:51:28.183831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.183706    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"]
Oct 30 19:51:28.184004 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.183885    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-61d11a\""
Oct 30 19:51:28.184004 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.183955    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-61d11a-dockercfg-8sjcb\""
Oct 30 19:51:28.250256 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.250222    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-plugins-config-volume\") pod \"payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf\" (UID: \"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea\") " pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:51:28.250531 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.250509    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s88q\" (UniqueName: \"kubernetes.io/projected/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-kube-api-access-6s88q\") pod \"payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf\" (UID: \"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea\") " pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:51:28.267383 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:51:28.267346    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:51:28.353705 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.353605    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s88q\" (UniqueName: \"kubernetes.io/projected/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-kube-api-access-6s88q\") pod \"payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf\" (UID: \"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea\") " pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:51:28.353900 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.353780    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-plugins-config-volume\") pod \"payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf\" (UID: \"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea\") " pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:51:28.355018 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.354991    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-plugins-config-volume\") pod \"payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf\" (UID: \"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea\") " pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:51:28.413758 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.413726    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s88q\" (UniqueName: \"kubernetes.io/projected/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-kube-api-access-6s88q\") pod \"payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf\" (UID: \"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea\") " pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:51:28.429652 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.429611    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:51:28.807976 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:28.807947    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"]
Oct 30 19:51:28.810888 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:51:28.810848    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0bc0d6d_e74e_419d_96fd_9e7c01dac6ea.slice/crio-8e7a6c0b5d1bc1951eee226c0c7c3e18702f1fb38d0cca8b6caa9179e492296c WatchSource:0}: Error finding container 8e7a6c0b5d1bc1951eee226c0c7c3e18702f1fb38d0cca8b6caa9179e492296c: Status 404 returned error can't find the container with id 8e7a6c0b5d1bc1951eee226c0c7c3e18702f1fb38d0cca8b6caa9179e492296c
Oct 30 19:51:29.520818 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:29.520778    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf" event={"ID":"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea","Type":"ContainerStarted","Data":"068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a"}
Oct 30 19:51:29.521071 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:29.520859    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:51:29.521071 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:29.520877    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf" event={"ID":"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea","Type":"ContainerStarted","Data":"8e7a6c0b5d1bc1951eee226c0c7c3e18702f1fb38d0cca8b6caa9179e492296c"}
Oct 30 19:51:29.633624 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:29.633530    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf" podStartSLOduration=1.6335150710000002 podStartE2EDuration="1.633515071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:51:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:51:29.631206318 +0000 UTC m=+1552.174013583" watchObservedRunningTime="2026-10-30 19:51:29.633515071 +0000 UTC m=+1552.176322336"
Oct 30 19:51:32.008431 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:32.008343    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:37.058662 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:37.058619    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:40.553642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:40.553605    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:51:42.189616 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:42.189577    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:46.914048 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:46.914005    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"]
Oct 30 19:51:46.920123 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:46.920091    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.017746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.017713    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-111f9c64-serving-cert\""
Oct 30 19:51:47.020783 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.020759    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"]
Oct 30 19:51:47.060499 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.060467    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwzl\" (UniqueName: \"kubernetes.io/projected/b5ede126-a103-4562-ad28-1d4086c140b2-kube-api-access-rtwzl\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.060677 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.060586    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-maas-api-tls\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.060731 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.060694    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5ede126-a103-4562-ad28-1d4086c140b2-openshift-service-ca\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.060890 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.060871    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-metrics-certs\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.151372 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.151337    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:47.161801 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.161764    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwzl\" (UniqueName: \"kubernetes.io/projected/b5ede126-a103-4562-ad28-1d4086c140b2-kube-api-access-rtwzl\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.161994 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.161852    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-maas-api-tls\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.161994 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.161914    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5ede126-a103-4562-ad28-1d4086c140b2-openshift-service-ca\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.162096 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:51:47.162007    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-serving-cert: secret "maas-api-e2e-mt-111f9c64-serving-cert" not found
Oct 30 19:51:47.162096 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:51:47.162089    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-maas-api-tls podName:b5ede126-a103-4562-ad28-1d4086c140b2 nodeName:}" failed. No retries permitted until 2026-10-30 19:51:47.66206656 +0000 UTC m=+1570.204873802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-maas-api-tls") pod "maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq" (UID: "b5ede126-a103-4562-ad28-1d4086c140b2") : secret "maas-api-e2e-mt-111f9c64-serving-cert" not found
Oct 30 19:51:47.162201 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.162105    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-metrics-certs\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.162699 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.162675    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5ede126-a103-4562-ad28-1d4086c140b2-openshift-service-ca\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.164709 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.164659    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-metrics-certs\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.222440 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.222405    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwzl\" (UniqueName: \"kubernetes.io/projected/b5ede126-a103-4562-ad28-1d4086c140b2-kube-api-access-rtwzl\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.351861 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.351719    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:47.510446 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.510351    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:47.668484 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.668450    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-maas-api-tls\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.671410 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.671375    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-maas-api-tls\") pod \"maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:47.834678 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:47.834643    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:48.222063 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:48.222037    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"]
Oct 30 19:51:48.224484 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:51:48.224454    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ede126_a103_4562_ad28_1d4086c140b2.slice/crio-4d05f1b8e7cf38badd942a0f78a32e2ea846cc5afc09ef76eafe7b00af5ba084 WatchSource:0}: Error finding container 4d05f1b8e7cf38badd942a0f78a32e2ea846cc5afc09ef76eafe7b00af5ba084: Status 404 returned error can't find the container with id 4d05f1b8e7cf38badd942a0f78a32e2ea846cc5afc09ef76eafe7b00af5ba084
Oct 30 19:51:48.690549 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:48.690510    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq" event={"ID":"b5ede126-a103-4562-ad28-1d4086c140b2","Type":"ContainerStarted","Data":"4d05f1b8e7cf38badd942a0f78a32e2ea846cc5afc09ef76eafe7b00af5ba084"}
Oct 30 19:51:49.700223 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:49.700179    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq" event={"ID":"b5ede126-a103-4562-ad28-1d4086c140b2","Type":"ContainerStarted","Data":"412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3"}
Oct 30 19:51:49.700746 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:49.700716    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:49.816290 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:49.816235    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq" podStartSLOduration=2.944470998 podStartE2EDuration="3.816219984s" totalImagesPullingTime="871.748986ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:51:49.813001236 +0000 UTC m=+1572.355808510" watchObservedRunningTime="2026-10-30 19:51:49.816219984 +0000 UTC m=+1572.359027248"
Oct 30 19:51:52.486512 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:52.486475    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:55.714575 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:55.714546    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:51:57.516095 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:51:57.516056    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:51:58.218902 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:51:58.218864    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:52:02.406109 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:02.406063    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:02.586305 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:02.586257    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:02.736460 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:02.736343    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:07.710439 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:07.710396    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:12.758749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:12.758703    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:12.942234 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:12.942194    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:13.173182 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:13.173142    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:15.702302 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.702263    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"]
Oct 30 19:52:15.706882 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.706861    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.749463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.749430    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"]
Oct 30 19:52:15.753929 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.753900    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.767118 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.767087    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-cf283d-openshift-default-dockercfg-l2hvl\""
Oct 30 19:52:15.782501 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.782465    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-certs\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.782681 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.782520    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istiod-ca-cert\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.782681 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.782577    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-token\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.782681 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.782651    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-credential-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.782877 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.782686    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-podinfo\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.782877 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.782835    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-token\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.782989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.782906    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-envoy\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.782989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.782939    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.782989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.782968    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.783106 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.783033    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-podinfo\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.783156 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.783131    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-credential-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.783205 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.783186    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-certs\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.783247 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.783235    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c728de5a-3379-49dc-9c6b-9453ded4a93f-istiod-ca-cert\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.783281 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.783269    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4vzc\" (UniqueName: \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-kube-api-access-h4vzc\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.783328 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.783296    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-envoy\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.783424 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.783409    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-data\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.783465 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.783447    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtlf9\" (UniqueName: \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-kube-api-access-vtlf9\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.783509 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.783497    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-data\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.801294 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.801254    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"]
Oct 30 19:52:15.812901 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.812868    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"]
Oct 30 19:52:15.884789 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.884752    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-token\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.885025 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.884829    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-credential-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.885025 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.884863    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-podinfo\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.885025 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.884936    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-token\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.885025 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.884996    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-envoy\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.885296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885026    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.885296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885055    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.885296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885084    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-podinfo\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.885296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885147    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-credential-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.885296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885173    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-certs\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.885296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885221    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c728de5a-3379-49dc-9c6b-9453ded4a93f-istiod-ca-cert\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.885296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885254    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4vzc\" (UniqueName: \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-kube-api-access-h4vzc\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.885296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885282    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-envoy\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.885752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885308    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-data\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.885752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885352    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtlf9\" (UniqueName: \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-kube-api-access-vtlf9\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.885752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885362    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-credential-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.885752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885438    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-data\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.885752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885448    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.886092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885781    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-certs\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.886092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885788    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-data\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.886092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.885968    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.886278 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.886259    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-data\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.886391 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.886367    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c728de5a-3379-49dc-9c6b-9453ded4a93f-istiod-ca-cert\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.886631 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.886605    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-credential-socket\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.886733 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.886674    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-certs\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.886733 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.886713    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istiod-ca-cert\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.887390 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.887365    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istiod-ca-cert\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.887644 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.887615    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-certs\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.887957 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.887914    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-envoy\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.888392 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.888367    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-podinfo\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.889763 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.889002    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-podinfo\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.889948 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.889926    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-envoy\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.943646 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.943613    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-token\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.943862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.943707    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-token\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.943981 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.943960    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtlf9\" (UniqueName: \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-kube-api-access-vtlf9\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:15.944039 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.944011    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4vzc\" (UniqueName: \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-kube-api-access-h4vzc\") pod \"e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") " pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:15.986735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:15.986638    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:16.025827 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.025779    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:16.071408 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.071379    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:16.525842 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.525781    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"]
Oct 30 19:52:16.527441 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:52:16.527397    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc728de5a_3379_49dc_9c6b_9453ded4a93f.slice/crio-0158c1c55bf7bcf9cd38727a7b2215929e19360f81cdc5ca2f0a6776f4a52d06 WatchSource:0}: Error finding container 0158c1c55bf7bcf9cd38727a7b2215929e19360f81cdc5ca2f0a6776f4a52d06: Status 404 returned error can't find the container with id 0158c1c55bf7bcf9cd38727a7b2215929e19360f81cdc5ca2f0a6776f4a52d06
Oct 30 19:52:16.528941 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:52:16.528913    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b1bbbb_c9d8_44e1_8ce8_1f506aa2123d.slice/crio-b21c9080cd4266797eb65b19a6d35cd95f3331f43fcd2c7570ace58229ce4ae8 WatchSource:0}: Error finding container b21c9080cd4266797eb65b19a6d35cd95f3331f43fcd2c7570ace58229ce4ae8: Status 404 returned error can't find the container with id b21c9080cd4266797eb65b19a6d35cd95f3331f43fcd2c7570ace58229ce4ae8
Oct 30 19:52:16.529885 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.529862    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"]
Oct 30 19:52:16.531103 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.531070    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:52:16.531204 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.531149    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:52:16.531204 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.531076    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:52:16.531204 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.531192    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:52:16.531359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.531221    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:52:16.531359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.531256    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:52:16.737567 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.737533    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:16.907577 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.907523    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" event={"ID":"c728de5a-3379-49dc-9c6b-9453ded4a93f","Type":"ContainerStarted","Data":"e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4"}
Oct 30 19:52:16.907783 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.907614    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" event={"ID":"c728de5a-3379-49dc-9c6b-9453ded4a93f","Type":"ContainerStarted","Data":"0158c1c55bf7bcf9cd38727a7b2215929e19360f81cdc5ca2f0a6776f4a52d06"}
Oct 30 19:52:16.911062 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.910729    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" event={"ID":"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d","Type":"ContainerStarted","Data":"076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1"}
Oct 30 19:52:16.911062 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:16.910791    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" event={"ID":"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d","Type":"ContainerStarted","Data":"b21c9080cd4266797eb65b19a6d35cd95f3331f43fcd2c7570ace58229ce4ae8"}
Oct 30 19:52:17.026778 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.026720    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" podStartSLOduration=2.02670256 podStartE2EDuration="2.02670256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:52:17.023537388 +0000 UTC m=+1599.566344654" watchObservedRunningTime="2026-10-30 19:52:17.02670256 +0000 UTC m=+1599.569509827"
Oct 30 19:52:17.027015 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.026959    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:17.028335 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.028311    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 19:52:17.028451 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.028357    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 19:52:17.072623 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.072586    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:17.074253 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.074223    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 19:52:17.074398 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.074307    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" podUID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 19:52:17.168950 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.165952    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" podStartSLOduration=2.16592686 podStartE2EDuration="2.16592686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:52:17.160901906 +0000 UTC m=+1599.703709173" watchObservedRunningTime="2026-10-30 19:52:17.16592686 +0000 UTC m=+1599.708734127"
Oct 30 19:52:17.431373 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.431273    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"]
Oct 30 19:52:17.737931 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.737839    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:17.764961 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.764928    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:17.794637 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.794601    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"]
Oct 30 19:52:17.834944 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.834913    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4b1a4c-openshift-default-dockercfg-dss9r\""
Oct 30 19:52:17.941457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.939446    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-data\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:17.941457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.939507    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-certs\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:17.941457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.939582    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-istio-token\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:17.941457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.939618    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-credential-socket\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:17.941457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.939788    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f757f773-8081-4637-ba77-fa0dfe16404d-istio-podinfo\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:17.941457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.939844    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-envoy\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:17.941457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.940862    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f757f773-8081-4637-ba77-fa0dfe16404d-istiod-ca-cert\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:17.941457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.940906    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czvft\" (UniqueName: \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-kube-api-access-czvft\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:17.941457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:17.940953    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-socket\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.026401 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.026305    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 19:52:18.026669 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.026634    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 19:52:18.042533 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.042489    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f757f773-8081-4637-ba77-fa0dfe16404d-istiod-ca-cert\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.042745 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.042557    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czvft\" (UniqueName: \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-kube-api-access-czvft\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.042745 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.042615    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-socket\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.042879 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.042850    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-data\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.042937 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.042889    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-certs\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.043006 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.042990    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-istio-token\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.043056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.043038    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-credential-socket\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.043177 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.043149    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f757f773-8081-4637-ba77-fa0dfe16404d-istiod-ca-cert\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.043313 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.043282    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f757f773-8081-4637-ba77-fa0dfe16404d-istio-podinfo\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.043378 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.043341    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-envoy\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.043785 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.043756    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-socket\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.043785 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.043777    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-certs\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.043953 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.043828    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-credential-socket\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.043953 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.043863    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-data\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.046270 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.046245    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-envoy\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.046392 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.046357    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f757f773-8081-4637-ba77-fa0dfe16404d-istio-podinfo\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.046722 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.046700    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:18.072292 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.072260    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 19:52:18.072573 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.072545    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" podUID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 19:52:18.132865 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.124672    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czvft\" (UniqueName: \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-kube-api-access-czvft\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.145944 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.145547    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-istio-token\") pod \"e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") " pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.156344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.156310    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:18.720650 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.720617    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"]
Oct 30 19:52:18.721948 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:52:18.721885    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf757f773_8081_4637_ba77_fa0dfe16404d.slice/crio-4760ccca58eb52e17681cee5d0bb89638362de8c4ce4356b00ff9a15c78d5384 WatchSource:0}: Error finding container 4760ccca58eb52e17681cee5d0bb89638362de8c4ce4356b00ff9a15c78d5384: Status 404 returned error can't find the container with id 4760ccca58eb52e17681cee5d0bb89638362de8c4ce4356b00ff9a15c78d5384
Oct 30 19:52:18.724726 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.724694    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:52:18.724835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.724766    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:52:18.724910 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.724797    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:52:18.934375 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.934337    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:18.947860 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.947801    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" event={"ID":"f757f773-8081-4637-ba77-fa0dfe16404d","Type":"ContainerStarted","Data":"79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3"}
Oct 30 19:52:18.948048 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:18.947886    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" event={"ID":"f757f773-8081-4637-ba77-fa0dfe16404d","Type":"ContainerStarted","Data":"4760ccca58eb52e17681cee5d0bb89638362de8c4ce4356b00ff9a15c78d5384"}
Oct 30 19:52:19.027904 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:19.027250    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 19:52:19.027904 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:19.027310    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 19:52:19.075832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:19.074253    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 19:52:19.075832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:19.074332    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" podUID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 19:52:19.123241 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:19.123168    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" podStartSLOduration=2.123143039 podStartE2EDuration="2.123143039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:52:19.091713717 +0000 UTC m=+1601.634521030" watchObservedRunningTime="2026-10-30 19:52:19.123143039 +0000 UTC m=+1601.665950305"
Oct 30 19:52:19.156497 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:19.156466    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:19.158016 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:19.157998    6015 patch_prober.go:29] interesting pod/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 19:52:19.158063 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:19.158039    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 19:52:20.026700 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:20.026669    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 19:52:20.027189 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:20.027164    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 19:52:20.072308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:20.072267    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 19:52:20.072561 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:20.072531    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" podUID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 19:52:20.162538 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:20.162323    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:20.961400 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:20.961362    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:20.962531 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:20.962507    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:52:21.027217 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:21.026437    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 19:52:21.027217 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:21.026509    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 19:52:21.080832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:21.075203    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 19:52:21.080832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:21.075266    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" podUID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 19:52:21.830370 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:21.830230    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:22.017738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:22.016931    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:22.026785 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:22.026755    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 19:52:22.026973 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:22.026826    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 19:52:22.087836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:22.087714    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 19:52:22.088421 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:22.088391    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" podUID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 19:52:22.234859 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:22.234015    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:22.437092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:22.434562    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:22.756695 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:22.756417    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:23.006404 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:23.006365    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:23.026696 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:23.026602    6015 patch_prober.go:29] interesting pod/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 19:52:23.026696 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:23.026672    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 19:52:23.202522 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:23.201959    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:23.203148 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:23.202652    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:23.204451 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:23.204359    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:52:24.030566 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:24.030532    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:24.031073 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:24.031058    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:24.031853 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:24.031833    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:52:24.637605 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:24.637574    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:25.814371 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:25.814328    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:26.015120 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.015080    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:26.240852 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.240757    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"]
Oct 30 19:52:26.245335 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.245313    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:52:26.299751 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.295607    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-4b1a4c\""
Oct 30 19:52:26.341444 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.341401    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-4b1a4c-dockercfg-jrrh6\""
Oct 30 19:52:26.348180 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.348142    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"]
Oct 30 19:52:26.351359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.351322    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"]
Oct 30 19:52:26.355938 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.355912    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:52:26.425835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.421968    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l\" (UID: \"56a49ad4-d50a-4d0c-9dfe-7d93b909c282\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:52:26.447833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.438112    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9l4x\" (UniqueName: \"kubernetes.io/projected/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-kube-api-access-v9l4x\") pod \"payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l\" (UID: \"56a49ad4-d50a-4d0c-9dfe-7d93b909c282\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:52:26.486014 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.485865    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"]
Oct 30 19:52:26.539989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.539491    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l\" (UID: \"56a49ad4-d50a-4d0c-9dfe-7d93b909c282\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:52:26.540301 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.540279    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv\" (UID: \"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:52:26.540489 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.540441    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9l4x\" (UniqueName: \"kubernetes.io/projected/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-kube-api-access-v9l4x\") pod \"payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l\" (UID: \"56a49ad4-d50a-4d0c-9dfe-7d93b909c282\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:52:26.540864 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.540846    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5h7l\" (UniqueName: \"kubernetes.io/projected/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-kube-api-access-r5h7l\") pod \"payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv\" (UID: \"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:52:26.545520 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.541500    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l\" (UID: \"56a49ad4-d50a-4d0c-9dfe-7d93b909c282\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:52:26.599938 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.599905    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9l4x\" (UniqueName: \"kubernetes.io/projected/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-kube-api-access-v9l4x\") pod \"payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l\" (UID: \"56a49ad4-d50a-4d0c-9dfe-7d93b909c282\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:52:26.642198 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.642162    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv\" (UID: \"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:52:26.642405 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.642386    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5h7l\" (UniqueName: \"kubernetes.io/projected/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-kube-api-access-r5h7l\") pod \"payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv\" (UID: \"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:52:26.643044 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.643026    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv\" (UID: \"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:52:26.701392 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.701359    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5h7l\" (UniqueName: \"kubernetes.io/projected/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-kube-api-access-r5h7l\") pod \"payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv\" (UID: \"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e\") " pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:52:26.733851 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.733794    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:52:26.860794 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.860758    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:52:26.992858 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:26.992762    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:27.117772 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:27.117740    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"]
Oct 30 19:52:27.119118 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:52:27.119092    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e63d2f_fed9_4b80_be6f_794d8cf9fa1e.slice/crio-58d34885e26b6c993e68e0246d15c80f8bc77aa27c1dd69d5053ba452fc8600c WatchSource:0}: Error finding container 58d34885e26b6c993e68e0246d15c80f8bc77aa27c1dd69d5053ba452fc8600c: Status 404 returned error can't find the container with id 58d34885e26b6c993e68e0246d15c80f8bc77aa27c1dd69d5053ba452fc8600c
Oct 30 19:52:27.220859 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:27.220823    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:27.246545 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:27.246519    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"]
Oct 30 19:52:27.248182 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:52:27.248157    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a49ad4_d50a_4d0c_9dfe_7d93b909c282.slice/crio-d3f07d08cd1ad6e88dbd656e5c23494e962f330300b4e7d9248b6729eefb2291 WatchSource:0}: Error finding container d3f07d08cd1ad6e88dbd656e5c23494e962f330300b4e7d9248b6729eefb2291: Status 404 returned error can't find the container with id d3f07d08cd1ad6e88dbd656e5c23494e962f330300b4e7d9248b6729eefb2291
Oct 30 19:52:27.421339 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:27.421249    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:28.037862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:28.037787    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv" event={"ID":"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e","Type":"ContainerStarted","Data":"6f64ad828f6df8a8b667c92560dd2667699a44dd7ff8b7002a821ced0519a041"}
Oct 30 19:52:28.038352 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:28.037887    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:52:28.038352 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:28.037912    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv" event={"ID":"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e","Type":"ContainerStarted","Data":"58d34885e26b6c993e68e0246d15c80f8bc77aa27c1dd69d5053ba452fc8600c"}
Oct 30 19:52:28.039483 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:28.039462    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l" event={"ID":"56a49ad4-d50a-4d0c-9dfe-7d93b909c282","Type":"ContainerStarted","Data":"28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039"}
Oct 30 19:52:28.039553 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:28.039501    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l" event={"ID":"56a49ad4-d50a-4d0c-9dfe-7d93b909c282","Type":"ContainerStarted","Data":"d3f07d08cd1ad6e88dbd656e5c23494e962f330300b4e7d9248b6729eefb2291"}
Oct 30 19:52:28.039613 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:28.039560    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:52:28.150879 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:28.150827    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv" podStartSLOduration=2.150793556 podStartE2EDuration="2.150793556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:52:28.148597966 +0000 UTC m=+1610.691405242" watchObservedRunningTime="2026-10-30 19:52:28.150793556 +0000 UTC m=+1610.693600863"
Oct 30 19:52:28.223107 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:52:28.223065    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:52:28.261500 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:28.261449    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l" podStartSLOduration=2.261434238 podStartE2EDuration="2.261434238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:52:28.258878366 +0000 UTC m=+1610.801685634" watchObservedRunningTime="2026-10-30 19:52:28.261434238 +0000 UTC m=+1610.804241504"
Oct 30 19:52:30.402249 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:30.402202    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:31.289709 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:31.289657    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:31.491546 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:31.491508    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:36.092177 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:36.092137    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:39.048989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:39.048949    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:52:39.049414 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:39.049033    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:52:41.141647 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:41.141609    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:46.153526 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:46.153442    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:47.740241 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:47.740208    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:51.384295 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:51.384259    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:52.750236 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:52.750190    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:56.979961 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:56.979923    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:58.011223 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:52:58.011178    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:52:58.217185 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:52:58.217145    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:53:02.095840 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:02.095779    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:07.297940 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:07.297901    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:08.932080 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:08.932029    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:12.759578 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:12.759539    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:18.311791 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:18.311758    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:22.380884 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:22.380796    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"]
Oct 30 19:53:22.497848 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:22.497780    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"]
Oct 30 19:53:22.851449 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:22.851419    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:23.012954 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.012913    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:23.524949 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.524916    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"]
Oct 30 19:53:23.530966 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.530937    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.581390 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.581360    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-4b1a4c-serving-cert\""
Oct 30 19:53:23.593039 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.593008    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"]
Oct 30 19:53:23.695630 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.695591    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-maas-api-tls\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.695994 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.695963    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e838e013-fe73-4e68-8071-b552d8aa6943-openshift-service-ca\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.696216 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.696198    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-metrics-certs\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.696475 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.696455    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58f96\" (UniqueName: \"kubernetes.io/projected/e838e013-fe73-4e68-8071-b552d8aa6943-kube-api-access-58f96\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.736240 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.736205    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:23.798449 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.798414    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58f96\" (UniqueName: \"kubernetes.io/projected/e838e013-fe73-4e68-8071-b552d8aa6943-kube-api-access-58f96\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.798633 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.798615    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-maas-api-tls\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.798705 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.798675    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e838e013-fe73-4e68-8071-b552d8aa6943-openshift-service-ca\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.798780 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.798765    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-metrics-certs\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.798869 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:53:23.798782    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-serving-cert: secret "maas-api-e2e-api-b-4b1a4c-serving-cert" not found
Oct 30 19:53:23.798935 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:53:23.798887    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-maas-api-tls podName:e838e013-fe73-4e68-8071-b552d8aa6943 nodeName:}" failed. No retries permitted until 2026-10-30 19:53:24.298863796 +0000 UTC m=+1666.841671053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-maas-api-tls") pod "maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2" (UID: "e838e013-fe73-4e68-8071-b552d8aa6943") : secret "maas-api-e2e-api-b-4b1a4c-serving-cert" not found
Oct 30 19:53:23.799601 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.799531    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e838e013-fe73-4e68-8071-b552d8aa6943-openshift-service-ca\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.801637 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.801612    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-metrics-certs\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.857378 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.857345    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58f96\" (UniqueName: \"kubernetes.io/projected/e838e013-fe73-4e68-8071-b552d8aa6943-kube-api-access-58f96\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:23.889631 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:23.889594    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:24.059163 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:24.059071    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:24.306900 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:24.306864    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-maas-api-tls\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:24.309735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:24.309664    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-maas-api-tls\") pod \"maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:24.446988 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:24.446949    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:24.572747 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:24.572658    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:24.863698 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:24.863667    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"]
Oct 30 19:53:24.864478 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:53:24.864454    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode838e013_fe73_4e68_8071_b552d8aa6943.slice/crio-712dfb26e519eceffea4d3a59d2c68d743e5f1c64bc00d169f18c733879c7cb7 WatchSource:0}: Error finding container 712dfb26e519eceffea4d3a59d2c68d743e5f1c64bc00d169f18c733879c7cb7: Status 404 returned error can't find the container with id 712dfb26e519eceffea4d3a59d2c68d743e5f1c64bc00d169f18c733879c7cb7
Oct 30 19:53:25.232758 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:25.232644    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:25.438231 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:25.438190    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:25.475049 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:25.474998    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2" event={"ID":"e838e013-fe73-4e68-8071-b552d8aa6943","Type":"ContainerStarted","Data":"712dfb26e519eceffea4d3a59d2c68d743e5f1c64bc00d169f18c733879c7cb7"}
Oct 30 19:53:26.486222 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:26.486169    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2" event={"ID":"e838e013-fe73-4e68-8071-b552d8aa6943","Type":"ContainerStarted","Data":"3321fe1ed171d1cd000f2697d6351c9c429fb6c57bdce9f35b2f5952ad5a3bf0"}
Oct 30 19:53:26.486647 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:26.486266    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:26.600912 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:26.600848    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2" podStartSLOduration=2.693062565 podStartE2EDuration="3.600826198s" totalImagesPullingTime="907.763633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:53:26.599224602 +0000 UTC m=+1669.142031866" watchObservedRunningTime="2026-10-30 19:53:26.600826198 +0000 UTC m=+1669.143633463"
Oct 30 19:53:27.382025 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.381975    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd" podUID="b2ff4d0d-5806-41cc-830e-04ee2ba3429c" containerName="payload-processing" containerID="cri-o://7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977" gracePeriod=25
Oct 30 19:53:27.498794 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.498742    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb" podUID="dc7d170e-cd97-44a3-841d-182cc6830678" containerName="payload-pre-processing" containerID="cri-o://7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7" gracePeriod=25
Oct 30 19:53:27.694381 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.694097    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:53:27.825615 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.825568    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:53:27.872984 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.872949    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-plugins-config-volume\") pod \"b2ff4d0d-5806-41cc-830e-04ee2ba3429c\" (UID: \"b2ff4d0d-5806-41cc-830e-04ee2ba3429c\") "
Oct 30 19:53:27.873172 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.873012    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-kube-api-access-9mhmr\" (UniqueName: \"kubernetes.io/projected/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-kube-api-access-9mhmr\") pod \"b2ff4d0d-5806-41cc-830e-04ee2ba3429c\" (UID: \"b2ff4d0d-5806-41cc-830e-04ee2ba3429c\") "
Oct 30 19:53:27.873359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.873335    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-plugins-config-volume" pod "b2ff4d0d-5806-41cc-830e-04ee2ba3429c" (UID: "b2ff4d0d-5806-41cc-830e-04ee2ba3429c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:53:27.873743 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.873721    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:53:27.875417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.875385    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-kube-api-access-9mhmr" pod "b2ff4d0d-5806-41cc-830e-04ee2ba3429c" (UID: "b2ff4d0d-5806-41cc-830e-04ee2ba3429c"). InnerVolumeSpecName "kube-api-access-9mhmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:53:27.975212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.975105    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc7d170e-cd97-44a3-841d-182cc6830678-kube-api-access-ngxx5\" (UniqueName: \"kubernetes.io/projected/dc7d170e-cd97-44a3-841d-182cc6830678-kube-api-access-ngxx5\") pod \"dc7d170e-cd97-44a3-841d-182cc6830678\" (UID: \"dc7d170e-cd97-44a3-841d-182cc6830678\") "
Oct 30 19:53:27.975395 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.975216    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dc7d170e-cd97-44a3-841d-182cc6830678-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc7d170e-cd97-44a3-841d-182cc6830678-plugins-config-volume\") pod \"dc7d170e-cd97-44a3-841d-182cc6830678\" (UID: \"dc7d170e-cd97-44a3-841d-182cc6830678\") "
Oct 30 19:53:27.976058 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.976023    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc7d170e-cd97-44a3-841d-182cc6830678-plugins-config-volume" pod "dc7d170e-cd97-44a3-841d-182cc6830678" (UID: "dc7d170e-cd97-44a3-841d-182cc6830678"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:53:27.976219 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.976197    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mhmr\" (UniqueName: \"kubernetes.io/projected/b2ff4d0d-5806-41cc-830e-04ee2ba3429c-kube-api-access-9mhmr\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:53:27.976290 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.976227    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc7d170e-cd97-44a3-841d-182cc6830678-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:53:27.978536 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:27.978502    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7d170e-cd97-44a3-841d-182cc6830678-kube-api-access-ngxx5" pod "dc7d170e-cd97-44a3-841d-182cc6830678" (UID: "dc7d170e-cd97-44a3-841d-182cc6830678"). InnerVolumeSpecName "kube-api-access-ngxx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:53:28.077514 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.077474    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngxx5\" (UniqueName: \"kubernetes.io/projected/dc7d170e-cd97-44a3-841d-182cc6830678-kube-api-access-ngxx5\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:53:28.219070 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:53:28.219034    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:53:28.503415 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.503379    6015 generic.go:356] "Generic (PLEG): container finished" podID="b2ff4d0d-5806-41cc-830e-04ee2ba3429c" containerID="7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977" exitCode=0
Oct 30 19:53:28.503902 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.503442    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"
Oct 30 19:53:28.503902 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.503462    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd" event={"ID":"b2ff4d0d-5806-41cc-830e-04ee2ba3429c","Type":"ContainerDied","Data":"7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977"}
Oct 30 19:53:28.503902 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.503519    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd" event={"ID":"b2ff4d0d-5806-41cc-830e-04ee2ba3429c","Type":"ContainerDied","Data":"88339d28b6c6788537cedcca6f0ff63ee99578eb7e219a17be44112ecd5f1ab8"}
Oct 30 19:53:28.503902 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.503545    6015 scope.go:122] "RemoveContainer" containerID="7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977"
Oct 30 19:53:28.505515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.505487    6015 generic.go:356] "Generic (PLEG): container finished" podID="dc7d170e-cd97-44a3-841d-182cc6830678" containerID="7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7" exitCode=0
Oct 30 19:53:28.505648 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.505547    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"
Oct 30 19:53:28.505648 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.505567    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb" event={"ID":"dc7d170e-cd97-44a3-841d-182cc6830678","Type":"ContainerDied","Data":"7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7"}
Oct 30 19:53:28.505648 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.505614    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb" event={"ID":"dc7d170e-cd97-44a3-841d-182cc6830678","Type":"ContainerDied","Data":"f3307b4b112a4f864913d9a2caf061d976925755a5b4ad8b589c5a4d37e8e1fa"}
Oct 30 19:53:28.514997 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.514980    6015 scope.go:122] "RemoveContainer" containerID="7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977"
Oct 30 19:53:28.515312 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:53:28.515290    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977\": container with ID starting with 7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977 not found: ID does not exist" containerID="7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977"
Oct 30 19:53:28.515366 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.515327    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977"} err="failed to get container status \"7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977\": rpc error: code = NotFound desc = could not find container \"7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977\": container with ID starting with 7e187a4595dea406b2fcf35df88c9bb644a01464a26df7bea0bc6fbf95ea1977 not found: ID does not exist"
Oct 30 19:53:28.515366 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.515350    6015 scope.go:122] "RemoveContainer" containerID="7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7"
Oct 30 19:53:28.526096 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.526079    6015 scope.go:122] "RemoveContainer" containerID="7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7"
Oct 30 19:53:28.526384 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:53:28.526355    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7\": container with ID starting with 7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7 not found: ID does not exist" containerID="7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7"
Oct 30 19:53:28.526476 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.526389    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7"} err="failed to get container status \"7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7\": rpc error: code = NotFound desc = could not find container \"7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7\": container with ID starting with 7f7e898a86946c073eea2b94bd06a9b0cb744447895bb3b8809b460236c74de7 not found: ID does not exist"
Oct 30 19:53:28.661260 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.661142    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"]
Oct 30 19:53:28.707570 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.707536    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8d3b6f-6df64bf7cf-9cndb"]
Oct 30 19:53:28.771473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.771440    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"]
Oct 30 19:53:28.776593 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:28.776544    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8d3b6f-5cb5cfd6f6-vkcpd"]
Oct 30 19:53:29.414554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:29.414521    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:29.587393 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:29.587360    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2ff4d0d-5806-41cc-830e-04ee2ba3429c" path="/var/lib/kubelet/pods/b2ff4d0d-5806-41cc-830e-04ee2ba3429c/volumes"
Oct 30 19:53:29.587927 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:29.587910    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc7d170e-cd97-44a3-841d-182cc6830678" path="/var/lib/kubelet/pods/dc7d170e-cd97-44a3-841d-182cc6830678/volumes"
Oct 30 19:53:29.791308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:29.791210    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:29.983593 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:29.983556    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:30.243010 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:30.242967    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:32.499989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:32.499959    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:53:34.632821 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.632772    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"]
Oct 30 19:53:34.633509 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.633491    6015 cpu_manager.go:414] "containerMap: removing container" podUID="dc7d170e-cd97-44a3-841d-182cc6830678" containerName="payload-pre-processing"
Oct 30 19:53:34.633571 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.633510    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc7d170e-cd97-44a3-841d-182cc6830678" containerName="payload-pre-processing"
Oct 30 19:53:34.633571 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.633530    6015 cpu_manager.go:414] "containerMap: removing container" podUID="b2ff4d0d-5806-41cc-830e-04ee2ba3429c" containerName="payload-processing"
Oct 30 19:53:34.633571 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.633537    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2ff4d0d-5806-41cc-830e-04ee2ba3429c" containerName="payload-processing"
Oct 30 19:53:34.633684 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.633666    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2ff4d0d-5806-41cc-830e-04ee2ba3429c" containerName="payload-processing"
Oct 30 19:53:34.633715 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.633693    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc7d170e-cd97-44a3-841d-182cc6830678" containerName="payload-pre-processing"
Oct 30 19:53:34.639276 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.639243    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.677012 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.676979    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-metrics-certs\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.677229 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.677208    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-maas-api-tls\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.677300 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.677270    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swc97\" (UniqueName: \"kubernetes.io/projected/09f49230-4ef8-4ce8-88ad-4ca5e788f854-kube-api-access-swc97\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.677437 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.677410    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09f49230-4ef8-4ce8-88ad-4ca5e788f854-openshift-service-ca\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.688842 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.688797    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-69932e-serving-cert\""
Oct 30 19:53:34.738850 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.738789    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"]
Oct 30 19:53:34.779448 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.779413    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swc97\" (UniqueName: \"kubernetes.io/projected/09f49230-4ef8-4ce8-88ad-4ca5e788f854-kube-api-access-swc97\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.780024 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.779892    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09f49230-4ef8-4ce8-88ad-4ca5e788f854-openshift-service-ca\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.780024 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.779992    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-metrics-certs\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.780223 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.780207    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-maas-api-tls\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.780388 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:53:34.780371    6015 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-serving-cert: secret "maas-api-e2e-api-a-69932e-serving-cert" not found
Oct 30 19:53:34.780466 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:53:34.780451    6015 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-maas-api-tls podName:09f49230-4ef8-4ce8-88ad-4ca5e788f854 nodeName:}" failed. No retries permitted until 2026-10-30 19:53:35.280429479 +0000 UTC m=+1677.823236739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-maas-api-tls") pod "maas-api-e2e-api-a-69932e-b569b7486-xs7q4" (UID: "09f49230-4ef8-4ce8-88ad-4ca5e788f854") : secret "maas-api-e2e-api-a-69932e-serving-cert" not found
Oct 30 19:53:34.780719 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.780695    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09f49230-4ef8-4ce8-88ad-4ca5e788f854-openshift-service-ca\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.783221 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.783196    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-metrics-certs\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.838117 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.838085    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swc97\" (UniqueName: \"kubernetes.io/projected/09f49230-4ef8-4ce8-88ad-4ca5e788f854-kube-api-access-swc97\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:34.861428 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:34.861396    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:35.057420 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:35.057385    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:35.287819 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:35.287773    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-maas-api-tls\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:35.290476 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:35.290458    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-maas-api-tls\") pod \"maas-api-e2e-api-a-69932e-b569b7486-xs7q4\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:35.557185 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:35.557154    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:35.719483 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:35.719271    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:35.871935 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:35.871835    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:35.939176 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:35.939149    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"]
Oct 30 19:53:35.941045 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:53:35.941018    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f49230_4ef8_4ce8_88ad_4ca5e788f854.slice/crio-f3b0a68def0eac94481593b5ec2f68a1cec240f51524c18af3bddcda2011668d WatchSource:0}: Error finding container f3b0a68def0eac94481593b5ec2f68a1cec240f51524c18af3bddcda2011668d: Status 404 returned error can't find the container with id f3b0a68def0eac94481593b5ec2f68a1cec240f51524c18af3bddcda2011668d
Oct 30 19:53:36.570778 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:36.570741    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4" event={"ID":"09f49230-4ef8-4ce8-88ad-4ca5e788f854","Type":"ContainerStarted","Data":"f3b0a68def0eac94481593b5ec2f68a1cec240f51524c18af3bddcda2011668d"}
Oct 30 19:53:37.586875 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:37.586838    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4" event={"ID":"09f49230-4ef8-4ce8-88ad-4ca5e788f854","Type":"ContainerStarted","Data":"dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0"}
Oct 30 19:53:37.695045 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:37.694991    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4" podStartSLOduration=2.874853045 podStartE2EDuration="3.694975076s" totalImagesPullingTime="820.122031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:53:37.693125222 +0000 UTC m=+1680.235932521" watchObservedRunningTime="2026-10-30 19:53:37.694975076 +0000 UTC m=+1680.237782340"
Oct 30 19:53:38.356685 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:38.356652    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:38.542122 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:38.542079    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:38.589515 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:38.589488    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:40.729859 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:40.729788    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:44.603417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:44.603386    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:53:45.994922 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:45.994888    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:48.104255 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:48.104206    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:51.121946 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:51.121890    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:56.386915 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:53:56.386878    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:53:58.218617 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:53:58.218574    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:54:00.767237 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:00.767123    6015 generic.go:356] "Generic (PLEG): container finished" podID="f757f773-8081-4637-ba77-fa0dfe16404d" containerID="79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3" exitCode=0
Oct 30 19:54:00.767237 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:00.767189    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" event={"ID":"f757f773-8081-4637-ba77-fa0dfe16404d","Type":"ContainerDied","Data":"79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3"}
Oct 30 19:54:00.767847 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:00.767781    6015 scope.go:122] "RemoveContainer" containerID="79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3"
Oct 30 19:54:00.769553 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:00.769523    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:54:00.769668 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:00.769596    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:54:00.769668 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:00.769629    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:54:01.603691 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:01.603653    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:01.804988 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:01.804947    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" event={"ID":"f757f773-8081-4637-ba77-fa0dfe16404d","Type":"ContainerStarted","Data":"ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb"}
Oct 30 19:54:02.156694 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:02.156644    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:54:02.158055 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:02.158028    6015 patch_prober.go:29] interesting pod/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 19:54:02.158173 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:02.158081    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 19:54:03.157582 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:03.157547    6015 patch_prober.go:29] interesting pod/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 19:54:03.158013 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:03.157600    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 19:54:04.157512 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:04.157473    6015 patch_prober.go:29] interesting pod/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 19:54:04.157701 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:04.157534    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 19:54:05.157447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:05.157406    6015 patch_prober.go:29] interesting pod/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 19:54:05.157662 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:05.157486    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 19:54:05.961232 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:05.961191    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:54:06.157232 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:06.157196    6015 patch_prober.go:29] interesting pod/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 19:54:06.157417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:06.157284    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 19:54:06.316677 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:06.316640    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:06.723884 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:06.723756    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:07.157336 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:07.157295    6015 patch_prober.go:29] interesting pod/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 19:54:07.157739 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:07.157364    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 19:54:08.161856 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:08.161794    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:54:08.163065 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:08.163041    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:54:11.801684 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:11.801650    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:16.899045 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:16.898928    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:21.986116 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:21.986078    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:27.015623 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:27.015573    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:28.218383 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:54:28.218342    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:54:32.044341 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:32.044307    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:32.247567 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:32.247527    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:34.842792 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:34.842756    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:37.785563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:37.785506    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:43.248488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:43.248449    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:48.541946 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:48.541907    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:48.829230 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:48.829197    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:50.186630 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:50.186597    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:51.707665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:51.707599    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:52.022643 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:52.022452    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:52.266313 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:52.266278    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:54.580503 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:54.580462    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:56.936694 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:56.936656    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:57.117859 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:57.117797    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:57.286766 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:57.286665    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:54:58.216654 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:54:58.216616    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:54:59.964492 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:54:59.964455    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:00.264355 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:00.264264    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:00.479881 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:00.479843    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:05.103207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:05.103151    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:09.167993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:09.167950    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"]
Oct 30 19:55:09.168411 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:09.168214    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy" containerID="cri-o://775d7f42f321286e8fe34b06f89159c958cc8e0b1f78e9c68c2308a6b5834a9a" gracePeriod=30
Oct 30 19:55:09.215302 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:09.215259    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"]
Oct 30 19:55:09.215485 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:09.215465    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerName="istio-proxy" containerID="cri-o://a8baca38efab4a59c148d3311d99d2ed67157b0c373ef03156f13967c6c3c938" gracePeriod=30
Oct 30 19:55:10.206101 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:10.206064    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:14.413053 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.413013    6015 generic.go:356] "Generic (PLEG): container finished" podID="0fca59b7-1f91-4633-910e-688571b7abd3" containerID="775d7f42f321286e8fe34b06f89159c958cc8e0b1f78e9c68c2308a6b5834a9a" exitCode=0
Oct 30 19:55:14.413723 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.413619    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" event={"ID":"0fca59b7-1f91-4633-910e-688571b7abd3","Type":"ContainerDied","Data":"775d7f42f321286e8fe34b06f89159c958cc8e0b1f78e9c68c2308a6b5834a9a"}
Oct 30 19:55:14.416144 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.415900    6015 generic.go:356] "Generic (PLEG): container finished" podID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerID="a8baca38efab4a59c148d3311d99d2ed67157b0c373ef03156f13967c6c3c938" exitCode=0
Oct 30 19:55:14.416144 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.416083    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" event={"ID":"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2","Type":"ContainerDied","Data":"a8baca38efab4a59c148d3311d99d2ed67157b0c373ef03156f13967c6c3c938"}
Oct 30 19:55:14.519066 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.519029    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:55:14.582151 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.582120    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:55:14.620914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.620882    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0fca59b7-1f91-4633-910e-688571b7abd3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fca59b7-1f91-4633-910e-688571b7abd3-istiod-ca-cert\") pod \"0fca59b7-1f91-4633-910e-688571b7abd3\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") "
Oct 30 19:55:14.621095 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.620964    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-socket\") pod \"0fca59b7-1f91-4633-910e-688571b7abd3\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") "
Oct 30 19:55:14.621095 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621010    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-kube-api-access-lbrjx\" (UniqueName: \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-kube-api-access-lbrjx\") pod \"0fca59b7-1f91-4633-910e-688571b7abd3\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") "
Oct 30 19:55:14.621095 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621051    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-istio-token\" (UniqueName: \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-istio-token\") pod \"0fca59b7-1f91-4633-910e-688571b7abd3\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") "
Oct 30 19:55:14.621263 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621129    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-certs\") pod \"0fca59b7-1f91-4633-910e-688571b7abd3\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") "
Oct 30 19:55:14.621263 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621227    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-data\") pod \"0fca59b7-1f91-4633-910e-688571b7abd3\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") "
Oct 30 19:55:14.621365 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621328    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-credential-socket\") pod \"0fca59b7-1f91-4633-910e-688571b7abd3\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") "
Oct 30 19:55:14.621365 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621357    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0fca59b7-1f91-4633-910e-688571b7abd3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fca59b7-1f91-4633-910e-688571b7abd3-istio-podinfo\") pod \"0fca59b7-1f91-4633-910e-688571b7abd3\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") "
Oct 30 19:55:14.621503 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621479    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-envoy\") pod \"0fca59b7-1f91-4633-910e-688571b7abd3\" (UID: \"0fca59b7-1f91-4633-910e-688571b7abd3\") "
Oct 30 19:55:14.621745 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621271    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-socket" pod "0fca59b7-1f91-4633-910e-688571b7abd3" (UID: "0fca59b7-1f91-4633-910e-688571b7abd3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:14.621868 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621315    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fca59b7-1f91-4633-910e-688571b7abd3-istiod-ca-cert" pod "0fca59b7-1f91-4633-910e-688571b7abd3" (UID: "0fca59b7-1f91-4633-910e-688571b7abd3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:55:14.621868 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621452    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-certs" pod "0fca59b7-1f91-4633-910e-688571b7abd3" (UID: "0fca59b7-1f91-4633-910e-688571b7abd3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:14.621868 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621639    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-credential-socket" pod "0fca59b7-1f91-4633-910e-688571b7abd3" (UID: "0fca59b7-1f91-4633-910e-688571b7abd3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:14.621868 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.621691    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-data" pod "0fca59b7-1f91-4633-910e-688571b7abd3" (UID: "0fca59b7-1f91-4633-910e-688571b7abd3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:14.622412 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.622374    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.622412 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.622402    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.622601 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.622418    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.622601 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.622433    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.622601 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.622449    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fca59b7-1f91-4633-910e-688571b7abd3-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.623625 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.623600    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-istio-token" pod "0fca59b7-1f91-4633-910e-688571b7abd3" (UID: "0fca59b7-1f91-4633-910e-688571b7abd3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:55:14.623704 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.623632    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-envoy" pod "0fca59b7-1f91-4633-910e-688571b7abd3" (UID: "0fca59b7-1f91-4633-910e-688571b7abd3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:14.623796 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.623780    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-kube-api-access-lbrjx" pod "0fca59b7-1f91-4633-910e-688571b7abd3" (UID: "0fca59b7-1f91-4633-910e-688571b7abd3"). InnerVolumeSpecName "kube-api-access-lbrjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:55:14.623870 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.623835    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0fca59b7-1f91-4633-910e-688571b7abd3-istio-podinfo" pod "0fca59b7-1f91-4633-910e-688571b7abd3" (UID: "0fca59b7-1f91-4633-910e-688571b7abd3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:55:14.723303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.723195    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-kube-api-access-fmww4\" (UniqueName: \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-kube-api-access-fmww4\") pod \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") "
Oct 30 19:55:14.723303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.723275    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-socket\") pod \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") "
Oct 30 19:55:14.723551 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.723397    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-certs\") pod \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") "
Oct 30 19:55:14.723551 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.723478    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-credential-socket\") pod \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") "
Oct 30 19:55:14.723551 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.723511    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-podinfo\") pod \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") "
Oct 30 19:55:14.723734 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.723557    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-token\" (UniqueName: \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-token\") pod \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") "
Oct 30 19:55:14.723734 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.723588    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istiod-ca-cert\") pod \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") "
Oct 30 19:55:14.723734 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.723682    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-socket" pod "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" (UID: "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:14.723734 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.723715    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-envoy\") pod \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") "
Oct 30 19:55:14.723980 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.723746    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-data\") pod \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\" (UID: \"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2\") "
Oct 30 19:55:14.723980 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.723918    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-certs" pod "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" (UID: "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:14.724415 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.724385    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-credential-socket" pod "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" (UID: "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:14.724415 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.724404    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istiod-ca-cert" pod "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" (UID: "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:55:14.725092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.724682    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.725092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.724710    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbrjx\" (UniqueName: \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-kube-api-access-lbrjx\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.725092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.724728    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fca59b7-1f91-4633-910e-688571b7abd3-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.725092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.724746    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.725092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.724760    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.725092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.724774    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.725092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.724789    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fca59b7-1f91-4633-910e-688571b7abd3-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.725092 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.724847    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fca59b7-1f91-4633-910e-688571b7abd3-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.725685 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.725650    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-data" pod "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" (UID: "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:14.727149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.726980    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-envoy" pod "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" (UID: "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:55:14.727598 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.727570    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-kube-api-access-fmww4" pod "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" (UID: "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2"). InnerVolumeSpecName "kube-api-access-fmww4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:55:14.727702 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.727641    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-token" pod "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" (UID: "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:55:14.727903 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.727881    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-podinfo" pod "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" (UID: "29ff0b74-8ca4-4b0d-a453-f86fe5a240a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:55:14.826049 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.826009    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmww4\" (UniqueName: \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-kube-api-access-fmww4\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.826049 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.826040    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.826049 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.826050    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.826049 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.826059    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:14.826442 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:14.826067    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:15.012506 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.012393    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"]
Oct 30 19:55:15.012821 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.012764    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4" podUID="5c8770f9-b6b3-4db7-ba7d-66406bd7c936" containerName="maas-api" containerID="cri-o://f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060" gracePeriod=30
Oct 30 19:55:15.108108 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:55:15.108063    6015 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8770f9_b6b3_4db7_ba7d_66406bd7c936.slice/crio-conmon-f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 19:55:15.127030 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.126990    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:15.327116 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.327086    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:55:15.436192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.435838    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-maas-api-tls\") pod \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") "
Oct 30 19:55:15.436192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.436025    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-kube-api-access-jmm8c\" (UniqueName: \"kubernetes.io/projected/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-kube-api-access-jmm8c\") pod \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") "
Oct 30 19:55:15.436192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.436084    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-metrics-certs\") pod \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") "
Oct 30 19:55:15.436192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.436179    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-openshift-service-ca\") pod \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\" (UID: \"5c8770f9-b6b3-4db7-ba7d-66406bd7c936\") "
Oct 30 19:55:15.439850 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.437233    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-openshift-service-ca" pod "5c8770f9-b6b3-4db7-ba7d-66406bd7c936" (UID: "5c8770f9-b6b3-4db7-ba7d-66406bd7c936"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:55:15.468881 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.461374    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" event={"ID":"0fca59b7-1f91-4633-910e-688571b7abd3","Type":"ContainerDied","Data":"001c05b198c1b5dfa51fd2273f7926518a0362865b0f4ab391b3fbc47b9ca904"}
Oct 30 19:55:15.468881 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.461450    6015 scope.go:122] "RemoveContainer" containerID="775d7f42f321286e8fe34b06f89159c958cc8e0b1f78e9c68c2308a6b5834a9a"
Oct 30 19:55:15.468881 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.461654    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"
Oct 30 19:55:15.468881 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.465348    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-maas-api-tls" pod "5c8770f9-b6b3-4db7-ba7d-66406bd7c936" (UID: "5c8770f9-b6b3-4db7-ba7d-66406bd7c936"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:55:15.475745 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.475352    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-metrics-certs" pod "5c8770f9-b6b3-4db7-ba7d-66406bd7c936" (UID: "5c8770f9-b6b3-4db7-ba7d-66406bd7c936"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:55:15.509846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.482124    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 19:55:15.509846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.482199    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:55:15.509846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.488568    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-kube-api-access-jmm8c" pod "5c8770f9-b6b3-4db7-ba7d-66406bd7c936" (UID: "5c8770f9-b6b3-4db7-ba7d-66406bd7c936"). InnerVolumeSpecName "kube-api-access-jmm8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:55:15.509846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.491731    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx" event={"ID":"29ff0b74-8ca4-4b0d-a453-f86fe5a240a2","Type":"ContainerDied","Data":"1a61ba8297dad4c66295ad3969d335363bd742ce81203f6727133611d9a82033"}
Oct 30 19:55:15.509846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.491895    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"
Oct 30 19:55:15.509846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.498774    6015 generic.go:356] "Generic (PLEG): container finished" podID="5c8770f9-b6b3-4db7-ba7d-66406bd7c936" containerID="f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060" exitCode=0
Oct 30 19:55:15.509846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.498901    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4" event={"ID":"5c8770f9-b6b3-4db7-ba7d-66406bd7c936","Type":"ContainerDied","Data":"f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060"}
Oct 30 19:55:15.509846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.498954    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4" event={"ID":"5c8770f9-b6b3-4db7-ba7d-66406bd7c936","Type":"ContainerDied","Data":"93e64afceff3a139c27aebe9aff06ec8a07a4f8b89bdbfd4bfd4398dce363ac2"}
Oct 30 19:55:15.509846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.499037    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"
Oct 30 19:55:15.541360 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.540136    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:15.541360 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.540178    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmm8c\" (UniqueName: \"kubernetes.io/projected/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-kube-api-access-jmm8c\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:15.541360 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.540196    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:15.541360 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.540209    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8770f9-b6b3-4db7-ba7d-66406bd7c936-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:15.641049 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.641018    6015 scope.go:122] "RemoveContainer" containerID="a8baca38efab4a59c148d3311d99d2ed67157b0c373ef03156f13967c6c3c938"
Oct 30 19:55:15.654688 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.654664    6015 scope.go:122] "RemoveContainer" containerID="f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060"
Oct 30 19:55:15.664706 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.664683    6015 scope.go:122] "RemoveContainer" containerID="f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060"
Oct 30 19:55:15.665247 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:55:15.665223    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060\": container with ID starting with f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060 not found: ID does not exist" containerID="f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060"
Oct 30 19:55:15.665353 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.665254    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060"} err="failed to get container status \"f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060\": rpc error: code = NotFound desc = could not find container \"f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060\": container with ID starting with f96833a33c21038dedb7a11021a8887cced600183ee9fb76c9e8b229654f4060 not found: ID does not exist"
Oct 30 19:55:15.799152 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.799116    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"]
Oct 30 19:55:15.803951 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.803920    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-h7pqx"]
Oct 30 19:55:15.917173 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.917075    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"]
Oct 30 19:55:15.917424 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:15.917405    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8d3b6f-79b8d47b55-5hdh4"]
Oct 30 19:55:16.017052 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:16.017016    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"]
Oct 30 19:55:16.021133 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:16.021098    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-w2btn"]
Oct 30 19:55:16.871350 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:16.871309    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:17.316191 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:17.316152    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:17.470645 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:17.470602    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:17.589709 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:17.589604    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" path="/var/lib/kubelet/pods/0fca59b7-1f91-4633-910e-688571b7abd3/volumes"
Oct 30 19:55:17.590288 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:17.590251    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" path="/var/lib/kubelet/pods/29ff0b74-8ca4-4b0d-a453-f86fe5a240a2/volumes"
Oct 30 19:55:17.590750 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:17.590730    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c8770f9-b6b3-4db7-ba7d-66406bd7c936" path="/var/lib/kubelet/pods/5c8770f9-b6b3-4db7-ba7d-66406bd7c936/volumes"
Oct 30 19:55:17.940547 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:17.940453    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:21.375420 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:21.375381    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"]
Oct 30 19:55:21.656733 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:21.656640    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:21.815910 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:21.815793    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:22.818961 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:22.818915    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:24.582542 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:24.582510    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:24.804020 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:24.803987    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:24.977133 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:24.977041    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:26.376151 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:26.375685    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn" podUID="2d1dc762-cde5-4a68-9572-145675e60f8b" containerName="payload-pre-processing" containerID="cri-o://db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a" gracePeriod=25
Oct 30 19:55:28.216827 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:55:28.216765    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:55:28.475239 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:28.475129    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:34.032341 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:34.032297    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:36.259952 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:36.259907    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn" podUID="2d1dc762-cde5-4a68-9572-145675e60f8b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:55:37.716598 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:37.716556    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:37.872715 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:37.872673    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:39.569135 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:39.569095    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:45.262903 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:45.262860    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:46.259403 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.259313    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn" podUID="2d1dc762-cde5-4a68-9572-145675e60f8b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 19:55:46.693825 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.693777    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:55:46.737970 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.737940    6015 generic.go:356] "Generic (PLEG): container finished" podID="2d1dc762-cde5-4a68-9572-145675e60f8b" containerID="db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a" exitCode=0
Oct 30 19:55:46.738170 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.737986    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"
Oct 30 19:55:46.738170 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.738020    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn" event={"ID":"2d1dc762-cde5-4a68-9572-145675e60f8b","Type":"ContainerDied","Data":"db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a"}
Oct 30 19:55:46.738170 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.738085    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn" event={"ID":"2d1dc762-cde5-4a68-9572-145675e60f8b","Type":"ContainerDied","Data":"415a8a5192c4d49ef94f8bf6898b2457ddc94bf4e27f79badf4d1a98ff192549"}
Oct 30 19:55:46.738170 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.738115    6015 scope.go:122] "RemoveContainer" containerID="db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a"
Oct 30 19:55:46.749002 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.748978    6015 scope.go:122] "RemoveContainer" containerID="db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a"
Oct 30 19:55:46.749328 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:55:46.749301    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a\": container with ID starting with db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a not found: ID does not exist" containerID="db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a"
Oct 30 19:55:46.749382 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.749342    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a"} err="failed to get container status \"db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a\": rpc error: code = NotFound desc = could not find container \"db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a\": container with ID starting with db8f83e672f9db42ada1538f32a336eb5af35130189585b25da99678a8de060a not found: ID does not exist"
Oct 30 19:55:46.780484 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.780446    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d1dc762-cde5-4a68-9572-145675e60f8b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d1dc762-cde5-4a68-9572-145675e60f8b-plugins-config-volume\") pod \"2d1dc762-cde5-4a68-9572-145675e60f8b\" (UID: \"2d1dc762-cde5-4a68-9572-145675e60f8b\") "
Oct 30 19:55:46.780484 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.780488    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d1dc762-cde5-4a68-9572-145675e60f8b-kube-api-access-r44qn\" (UniqueName: \"kubernetes.io/projected/2d1dc762-cde5-4a68-9572-145675e60f8b-kube-api-access-r44qn\") pod \"2d1dc762-cde5-4a68-9572-145675e60f8b\" (UID: \"2d1dc762-cde5-4a68-9572-145675e60f8b\") "
Oct 30 19:55:46.780912 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.780882    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1dc762-cde5-4a68-9572-145675e60f8b-plugins-config-volume" pod "2d1dc762-cde5-4a68-9572-145675e60f8b" (UID: "2d1dc762-cde5-4a68-9572-145675e60f8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:55:46.781326 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.781288    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d1dc762-cde5-4a68-9572-145675e60f8b-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:46.782914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.782892    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d1dc762-cde5-4a68-9572-145675e60f8b-kube-api-access-r44qn" pod "2d1dc762-cde5-4a68-9572-145675e60f8b" (UID: "2d1dc762-cde5-4a68-9572-145675e60f8b"). InnerVolumeSpecName "kube-api-access-r44qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:55:46.883031 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:46.882939    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r44qn\" (UniqueName: \"kubernetes.io/projected/2d1dc762-cde5-4a68-9572-145675e60f8b-kube-api-access-r44qn\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:55:47.154364 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:47.154273    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"]
Oct 30 19:55:47.158782 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:47.158753    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-111f9c64-7676b8f96c-tmffn"]
Oct 30 19:55:47.597101 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:47.597058    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d1dc762-cde5-4a68-9572-145675e60f8b" path="/var/lib/kubelet/pods/2d1dc762-cde5-4a68-9572-145675e60f8b/volumes"
Oct 30 19:55:48.042171 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:48.042064    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:48.882672 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:48.882636    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:51.009674 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:51.000860    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:56.607105 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:55:56.607063    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:55:58.217580 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:55:58.217485    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:56:00.878014 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:00.877978    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"]
Oct 30 19:56:01.262654 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:01.262559    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:01.418387 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:01.418333    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:02.239426 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:02.239387    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:05.878453 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:05.878405    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf" podUID="b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea" containerName="payload-processing" containerID="cri-o://068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a" gracePeriod=25
Oct 30 19:56:06.173011 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.172978    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:56:06.280941 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.280906    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-plugins-config-volume\") pod \"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea\" (UID: \"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea\") "
Oct 30 19:56:06.281137 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.281052    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-kube-api-access-6s88q\" (UniqueName: \"kubernetes.io/projected/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-kube-api-access-6s88q\") pod \"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea\" (UID: \"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea\") "
Oct 30 19:56:06.281407 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.281378    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-plugins-config-volume" pod "b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea" (UID: "b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:56:06.281682 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.281660    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:06.284320 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.283685    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-kube-api-access-6s88q" pod "b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea" (UID: "b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea"). InnerVolumeSpecName "kube-api-access-6s88q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:56:06.383154 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.383106    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s88q\" (UniqueName: \"kubernetes.io/projected/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea-kube-api-access-6s88q\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:06.892005 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.891967    6015 generic.go:356] "Generic (PLEG): container finished" podID="b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea" containerID="068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a" exitCode=0
Oct 30 19:56:06.892534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.892014    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf" event={"ID":"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea","Type":"ContainerDied","Data":"068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a"}
Oct 30 19:56:06.892534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.892040    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"
Oct 30 19:56:06.892534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.892114    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf" event={"ID":"b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea","Type":"ContainerDied","Data":"8e7a6c0b5d1bc1951eee226c0c7c3e18702f1fb38d0cca8b6caa9179e492296c"}
Oct 30 19:56:06.892534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.892147    6015 scope.go:122] "RemoveContainer" containerID="068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a"
Oct 30 19:56:06.903906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.903880    6015 scope.go:122] "RemoveContainer" containerID="068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a"
Oct 30 19:56:06.904272 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:56:06.904243    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a\": container with ID starting with 068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a not found: ID does not exist" containerID="068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a"
Oct 30 19:56:06.904340 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:06.904283    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a"} err="failed to get container status \"068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a\": rpc error: code = NotFound desc = could not find container \"068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a\": container with ID starting with 068cd0fe4450eb5e291e5290207412460e96c8b59b53875144f49f85a5d9613a not found: ID does not exist"
Oct 30 19:56:07.049431 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:07.049396    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"]
Oct 30 19:56:07.097930 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:07.097892    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-61d11a-7cbbf5dd98-5k6pf"]
Oct 30 19:56:07.248138 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:07.248044    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:07.423335 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:07.423302    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:07.581708 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:07.581671    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:07.589151 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:07.589117    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea" path="/var/lib/kubelet/pods/b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea/volumes"
Oct 30 19:56:12.599602 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:12.599563    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:17.817598 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:17.817555    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:22.215453 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.215418    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"]
Oct 30 19:56:22.216080 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.215668    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p" podUID="09422e2a-dfe9-42f3-8420-57fbbc15c0de" containerName="maas-api" containerID="cri-o://3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4" gracePeriod=30
Oct 30 19:56:22.331340 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.331163    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:22.521605 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.521574    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:56:22.627053 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.626557    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls\") pod \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") "
Oct 30 19:56:22.627586 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.627568    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09422e2a-dfe9-42f3-8420-57fbbc15c0de-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09422e2a-dfe9-42f3-8420-57fbbc15c0de-openshift-service-ca\") pod \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") "
Oct 30 19:56:22.628169 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.628049    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09422e2a-dfe9-42f3-8420-57fbbc15c0de-openshift-service-ca" pod "09422e2a-dfe9-42f3-8420-57fbbc15c0de" (UID: "09422e2a-dfe9-42f3-8420-57fbbc15c0de"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:56:22.628321 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.628304    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09422e2a-dfe9-42f3-8420-57fbbc15c0de-kube-api-access-c7mch\" (UniqueName: \"kubernetes.io/projected/09422e2a-dfe9-42f3-8420-57fbbc15c0de-kube-api-access-c7mch\") pod \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") "
Oct 30 19:56:22.628434 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.628420    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-metrics-certs\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-metrics-certs\") pod \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\" (UID: \"09422e2a-dfe9-42f3-8420-57fbbc15c0de\") "
Oct 30 19:56:22.659043 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.647856    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09422e2a-dfe9-42f3-8420-57fbbc15c0de-kube-api-access-c7mch" pod "09422e2a-dfe9-42f3-8420-57fbbc15c0de" (UID: "09422e2a-dfe9-42f3-8420-57fbbc15c0de"). InnerVolumeSpecName "kube-api-access-c7mch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:56:22.659927 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.659867    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls" pod "09422e2a-dfe9-42f3-8420-57fbbc15c0de" (UID: "09422e2a-dfe9-42f3-8420-57fbbc15c0de"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:56:22.660377 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.660346    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09422e2a-dfe9-42f3-8420-57fbbc15c0de-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:22.660377 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.660377    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7mch\" (UniqueName: \"kubernetes.io/projected/09422e2a-dfe9-42f3-8420-57fbbc15c0de-kube-api-access-c7mch\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:22.660563 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.660395    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:22.677844 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.665584    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-metrics-certs" pod "09422e2a-dfe9-42f3-8420-57fbbc15c0de" (UID: "09422e2a-dfe9-42f3-8420-57fbbc15c0de"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:56:22.775884 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:22.769871    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09422e2a-dfe9-42f3-8420-57fbbc15c0de-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:23.011169 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:23.011137    6015 generic.go:356] "Generic (PLEG): container finished" podID="09422e2a-dfe9-42f3-8420-57fbbc15c0de" containerID="3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4" exitCode=0
Oct 30 19:56:23.011344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:23.011205    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"
Oct 30 19:56:23.011344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:23.011221    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p" event={"ID":"09422e2a-dfe9-42f3-8420-57fbbc15c0de","Type":"ContainerDied","Data":"3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4"}
Oct 30 19:56:23.011344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:23.011278    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p" event={"ID":"09422e2a-dfe9-42f3-8420-57fbbc15c0de","Type":"ContainerDied","Data":"867644ab9e9942aa97856e8d743e0491ab354697e32381a5851c1ec38bc6c401"}
Oct 30 19:56:23.011344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:23.011302    6015 scope.go:122] "RemoveContainer" containerID="3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4"
Oct 30 19:56:23.022234 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:23.022212    6015 scope.go:122] "RemoveContainer" containerID="3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4"
Oct 30 19:56:23.022644 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:56:23.022610    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4\": container with ID starting with 3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4 not found: ID does not exist" containerID="3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4"
Oct 30 19:56:23.022751 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:23.022655    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4"} err="failed to get container status \"3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4\": rpc error: code = NotFound desc = could not find container \"3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4\": container with ID starting with 3b56ff17a36ded113f633dd12b6ffe45815b77d418950d6c6ddc4c6abe157eb4 not found: ID does not exist"
Oct 30 19:56:23.167689 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:23.167658    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"]
Oct 30 19:56:23.171981 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:23.171951    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-cf283d-f575f746b-r2p6p"]
Oct 30 19:56:23.586873 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:23.586841    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09422e2a-dfe9-42f3-8420-57fbbc15c0de" path="/var/lib/kubelet/pods/09422e2a-dfe9-42f3-8420-57fbbc15c0de/volumes"
Oct 30 19:56:24.004218 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:24.004133    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:24.306297 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:24.306245    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:24.462549 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:24.462512    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:25.068488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:25.068456    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:28.218530 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:56:28.218490    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:56:29.806501 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:29.806456    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:31.252549 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:31.252512    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:31.460756 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:31.460722    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:31.617489 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:31.617445    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"]
Oct 30 19:56:31.617732 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:31.617701    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerName="istio-proxy" containerID="cri-o://e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4" gracePeriod=30
Oct 30 19:56:31.633934 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:31.633898    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"]
Oct 30 19:56:31.634138 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:31.634116    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" podUID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" containerName="istio-proxy" containerID="cri-o://076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1" gracePeriod=30
Oct 30 19:56:31.639407 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:31.639364    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:35.387192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:35.387145    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:35.699085 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:35.698991    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"]
Oct 30 19:56:35.699342 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:35.699219    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerName="istio-proxy" containerID="cri-o://1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c" gracePeriod=30
Oct 30 19:56:36.937411 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:36.937379    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:56:36.941955 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:36.941931    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:56:37.002335 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002300    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-token\" (UniqueName: \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-token\") pod \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") "
Oct 30 19:56:37.002509 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002367    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-credential-socket\") pod \"c728de5a-3379-49dc-9c6b-9453ded4a93f\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") "
Oct 30 19:56:37.002509 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002402    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-data\") pod \"c728de5a-3379-49dc-9c6b-9453ded4a93f\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") "
Oct 30 19:56:37.002509 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002470    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-envoy\") pod \"c728de5a-3379-49dc-9c6b-9453ded4a93f\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") "
Oct 30 19:56:37.002509 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002497    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-certs\") pod \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") "
Oct 30 19:56:37.002749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002523    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-token\" (UniqueName: \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-token\") pod \"c728de5a-3379-49dc-9c6b-9453ded4a93f\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") "
Oct 30 19:56:37.002749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002577    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-socket\") pod \"c728de5a-3379-49dc-9c6b-9453ded4a93f\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") "
Oct 30 19:56:37.002749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002628    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-socket\") pod \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") "
Oct 30 19:56:37.002749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002668    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-podinfo\") pod \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") "
Oct 30 19:56:37.002749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002697    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-podinfo\") pod \"c728de5a-3379-49dc-9c6b-9453ded4a93f\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") "
Oct 30 19:56:37.002749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002681    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-credential-socket" pod "c728de5a-3379-49dc-9c6b-9453ded4a93f" (UID: "c728de5a-3379-49dc-9c6b-9453ded4a93f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:37.002749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002722    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-credential-socket\") pod \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") "
Oct 30 19:56:37.003142 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002801    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-kube-api-access-vtlf9\" (UniqueName: \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-kube-api-access-vtlf9\") pod \"c728de5a-3379-49dc-9c6b-9453ded4a93f\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") "
Oct 30 19:56:37.003142 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002858    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istiod-ca-cert\") pod \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") "
Oct 30 19:56:37.003142 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002885    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-certs\") pod \"c728de5a-3379-49dc-9c6b-9453ded4a93f\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") "
Oct 30 19:56:37.003142 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002954    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-envoy\") pod \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") "
Oct 30 19:56:37.003142 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002975    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-socket" pod "c728de5a-3379-49dc-9c6b-9453ded4a93f" (UID: "c728de5a-3379-49dc-9c6b-9453ded4a93f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:37.003142 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.003000    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-kube-api-access-h4vzc\" (UniqueName: \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-kube-api-access-h4vzc\") pod \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") "
Oct 30 19:56:37.003142 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.003022    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-data\") pod \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\" (UID: \"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d\") "
Oct 30 19:56:37.003142 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.002901    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-data" pod "c728de5a-3379-49dc-9c6b-9453ded4a93f" (UID: "c728de5a-3379-49dc-9c6b-9453ded4a93f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:37.003142 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.003095    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c728de5a-3379-49dc-9c6b-9453ded4a93f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c728de5a-3379-49dc-9c6b-9453ded4a93f-istiod-ca-cert\") pod \"c728de5a-3379-49dc-9c6b-9453ded4a93f\" (UID: \"c728de5a-3379-49dc-9c6b-9453ded4a93f\") "
Oct 30 19:56:37.003591 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.003365    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-credential-socket" pod "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" (UID: "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:37.003650 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.003607    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-certs" pod "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" (UID: "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:37.003887 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.003792    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-socket" pod "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" (UID: "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:37.003982 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.003937    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.004344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.004052    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.004344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.004142    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.004344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.004159    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.004344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.004172    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.005876 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.005792    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-envoy" pod "c728de5a-3379-49dc-9c6b-9453ded4a93f" (UID: "c728de5a-3379-49dc-9c6b-9453ded4a93f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:37.005876 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.005845    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-token" pod "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" (UID: "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:56:37.006074 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.006027    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-token" pod "c728de5a-3379-49dc-9c6b-9453ded4a93f" (UID: "c728de5a-3379-49dc-9c6b-9453ded4a93f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:56:37.006134 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.006079    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-data" pod "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" (UID: "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:37.006201 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.006099    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-podinfo" pod "c728de5a-3379-49dc-9c6b-9453ded4a93f" (UID: "c728de5a-3379-49dc-9c6b-9453ded4a93f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:56:37.006349 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.006318    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-certs" pod "c728de5a-3379-49dc-9c6b-9453ded4a93f" (UID: "c728de5a-3379-49dc-9c6b-9453ded4a93f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:37.006457 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.006417    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-envoy" pod "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" (UID: "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:37.006528 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.006455    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istiod-ca-cert" pod "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" (UID: "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:56:37.006528 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.006333    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-podinfo" pod "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" (UID: "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:56:37.006659 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.006540    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c728de5a-3379-49dc-9c6b-9453ded4a93f-istiod-ca-cert" pod "c728de5a-3379-49dc-9c6b-9453ded4a93f" (UID: "c728de5a-3379-49dc-9c6b-9453ded4a93f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:56:37.007070 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.007043    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-kube-api-access-h4vzc" pod "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" (UID: "67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d"). InnerVolumeSpecName "kube-api-access-h4vzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:56:37.008176 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.008154    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-kube-api-access-vtlf9" pod "c728de5a-3379-49dc-9c6b-9453ded4a93f" (UID: "c728de5a-3379-49dc-9c6b-9453ded4a93f"). InnerVolumeSpecName "kube-api-access-vtlf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105577    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105615    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105630    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105644    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105657    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105670    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c728de5a-3379-49dc-9c6b-9453ded4a93f-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105685    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtlf9\" (UniqueName: \"kubernetes.io/projected/c728de5a-3379-49dc-9c6b-9453ded4a93f-kube-api-access-vtlf9\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105699    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105713    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c728de5a-3379-49dc-9c6b-9453ded4a93f-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105725    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105740    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4vzc\" (UniqueName: \"kubernetes.io/projected/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-kube-api-access-h4vzc\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105754    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.105897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.105768    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c728de5a-3379-49dc-9c6b-9453ded4a93f-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:37.114334 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.114294    6015 generic.go:356] "Generic (PLEG): container finished" podID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerID="e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4" exitCode=0
Oct 30 19:56:37.114540 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.114358    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"
Oct 30 19:56:37.114540 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.114438    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" event={"ID":"c728de5a-3379-49dc-9c6b-9453ded4a93f","Type":"ContainerDied","Data":"e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4"}
Oct 30 19:56:37.114540 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.114489    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx" event={"ID":"c728de5a-3379-49dc-9c6b-9453ded4a93f","Type":"ContainerDied","Data":"0158c1c55bf7bcf9cd38727a7b2215929e19360f81cdc5ca2f0a6776f4a52d06"}
Oct 30 19:56:37.114540 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.114524    6015 scope.go:122] "RemoveContainer" containerID="e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4"
Oct 30 19:56:37.117333 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.117299    6015 generic.go:356] "Generic (PLEG): container finished" podID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" containerID="076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1" exitCode=0
Oct 30 19:56:37.117488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.117437    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" event={"ID":"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d","Type":"ContainerDied","Data":"076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1"}
Oct 30 19:56:37.117488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.117482    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv" event={"ID":"67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d","Type":"ContainerDied","Data":"b21c9080cd4266797eb65b19a6d35cd95f3331f43fcd2c7570ace58229ce4ae8"}
Oct 30 19:56:37.117626 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.117555    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"
Oct 30 19:56:37.143082 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.143049    6015 scope.go:122] "RemoveContainer" containerID="e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4"
Oct 30 19:56:37.143507 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:56:37.143470    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4\": container with ID starting with e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4 not found: ID does not exist" containerID="e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4"
Oct 30 19:56:37.143614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.143519    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4"} err="failed to get container status \"e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4\": rpc error: code = NotFound desc = could not find container \"e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4\": container with ID starting with e5c73f2be1c0cc0a110194a280fc39a31ed38876615584f5637835c1c19c99c4 not found: ID does not exist"
Oct 30 19:56:37.143614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.143546    6015 scope.go:122] "RemoveContainer" containerID="076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1"
Oct 30 19:56:37.160203 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.160178    6015 scope.go:122] "RemoveContainer" containerID="076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1"
Oct 30 19:56:37.160600 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:56:37.160571    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1\": container with ID starting with 076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1 not found: ID does not exist" containerID="076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1"
Oct 30 19:56:37.160732 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.160611    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1"} err="failed to get container status \"076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1\": rpc error: code = NotFound desc = could not find container \"076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1\": container with ID starting with 076e6aa806ce5cabbf83f3adc28ef38950b6cd6d640970ea46f3c0a3fc698bc1 not found: ID does not exist"
Oct 30 19:56:37.326264 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.326221    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"]
Oct 30 19:56:37.330870 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.330840    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-t59wv"]
Oct 30 19:56:37.434898 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.434787    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"]
Oct 30 19:56:37.450580 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.450547    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-cf283d-openshift-default-7c6cfc484f-gz5xx"]
Oct 30 19:56:37.591747 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.591685    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" path="/var/lib/kubelet/pods/67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d/volumes"
Oct 30 19:56:37.592303 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:37.592285    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" path="/var/lib/kubelet/pods/c728de5a-3379-49dc-9c6b-9453ded4a93f/volumes"
Oct 30 19:56:40.692801 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:40.692755    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:40.984216 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:40.984181    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:56:41.062212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.062172    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-credential-socket\") pod \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") "
Oct 30 19:56:41.062389 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.062221    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-podinfo\") pod \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") "
Oct 30 19:56:41.062389 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.062239    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istiod-ca-cert\") pod \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") "
Oct 30 19:56:41.062389 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.062328    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-data\") pod \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") "
Oct 30 19:56:41.062568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.062392    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-token\" (UniqueName: \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-token\") pod \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") "
Oct 30 19:56:41.062568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.062433    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-kube-api-access-cz8dp\" (UniqueName: \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-kube-api-access-cz8dp\") pod \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") "
Oct 30 19:56:41.062568 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.062519    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-credential-socket" pod "1e9d69e8-4d02-4d58-ae67-67d545aceffa" (UID: "1e9d69e8-4d02-4d58-ae67-67d545aceffa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:41.062727 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.062585    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-envoy\") pod \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") "
Oct 30 19:56:41.062781 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.062756    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-certs\") pod \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") "
Oct 30 19:56:41.062868 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.062836    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-socket\") pod \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\" (UID: \"1e9d69e8-4d02-4d58-ae67-67d545aceffa\") "
Oct 30 19:56:41.063480 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.062833    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istiod-ca-cert" pod "1e9d69e8-4d02-4d58-ae67-67d545aceffa" (UID: "1e9d69e8-4d02-4d58-ae67-67d545aceffa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:56:41.063480 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.063088    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-certs" pod "1e9d69e8-4d02-4d58-ae67-67d545aceffa" (UID: "1e9d69e8-4d02-4d58-ae67-67d545aceffa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:41.063480 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.063192    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-socket" pod "1e9d69e8-4d02-4d58-ae67-67d545aceffa" (UID: "1e9d69e8-4d02-4d58-ae67-67d545aceffa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:41.063480 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.063395    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-data" pod "1e9d69e8-4d02-4d58-ae67-67d545aceffa" (UID: "1e9d69e8-4d02-4d58-ae67-67d545aceffa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:41.064084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.064022    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:41.064084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.064052    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:41.064084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.064069    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:41.064084 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.064083    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:41.064297 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.064096    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:41.065049 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.065027    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-podinfo" pod "1e9d69e8-4d02-4d58-ae67-67d545aceffa" (UID: "1e9d69e8-4d02-4d58-ae67-67d545aceffa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:56:41.065244 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.065219    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-kube-api-access-cz8dp" pod "1e9d69e8-4d02-4d58-ae67-67d545aceffa" (UID: "1e9d69e8-4d02-4d58-ae67-67d545aceffa"). InnerVolumeSpecName "kube-api-access-cz8dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:56:41.065384 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.065361    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-token" pod "1e9d69e8-4d02-4d58-ae67-67d545aceffa" (UID: "1e9d69e8-4d02-4d58-ae67-67d545aceffa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:56:41.066218 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.066191    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-envoy" pod "1e9d69e8-4d02-4d58-ae67-67d545aceffa" (UID: "1e9d69e8-4d02-4d58-ae67-67d545aceffa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:56:41.148732 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.148642    6015 generic.go:356] "Generic (PLEG): container finished" podID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerID="1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c" exitCode=0
Oct 30 19:56:41.149043 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.148760    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" event={"ID":"1e9d69e8-4d02-4d58-ae67-67d545aceffa","Type":"ContainerDied","Data":"1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c"}
Oct 30 19:56:41.149043 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.148854    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" event={"ID":"1e9d69e8-4d02-4d58-ae67-67d545aceffa","Type":"ContainerDied","Data":"3ee99ecf76c1d53f71e2ce83378201a8e21681e8b0face53fda983f964f732ac"}
Oct 30 19:56:41.149043 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.148885    6015 scope.go:122] "RemoveContainer" containerID="1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c"
Oct 30 19:56:41.149043 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.149013    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"
Oct 30 19:56:41.161061 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.161039    6015 scope.go:122] "RemoveContainer" containerID="1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c"
Oct 30 19:56:41.161411 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:56:41.161386    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c\": container with ID starting with 1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c not found: ID does not exist" containerID="1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c"
Oct 30 19:56:41.161477 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.161418    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c"} err="failed to get container status \"1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c\": rpc error: code = NotFound desc = could not find container \"1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c\": container with ID starting with 1b719a61f21d9e65ea50b47819fec947bdce6472289f37bde8792bd98e18760c not found: ID does not exist"
Oct 30 19:56:41.165402 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.165381    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:41.165471 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.165405    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:41.165471 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.165414    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz8dp\" (UniqueName: \"kubernetes.io/projected/1e9d69e8-4d02-4d58-ae67-67d545aceffa-kube-api-access-cz8dp\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:41.165471 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.165423    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e9d69e8-4d02-4d58-ae67-67d545aceffa-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:41.322135 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.322097    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"]
Oct 30 19:56:41.327942 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.327911    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j"]
Oct 30 19:56:41.595752 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.595665    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" path="/var/lib/kubelet/pods/1e9d69e8-4d02-4d58-ae67-67d545aceffa/volumes"
Oct 30 19:56:41.926513 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.926420    6015 patch_prober.go:29] interesting pod/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 19:56:41.926513 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:41.926501    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-4ec609-openshift-default-66fc5976ff-dtr6j" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:56:44.031290 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:44.031250    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"]
Oct 30 19:56:44.142065 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:44.140952    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"]
Oct 30 19:56:44.413250 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:44.413212    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:44.605253 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:44.605216    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:45.806136 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:45.806100    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:49.032247 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.032178    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv" podUID="80e63d2f-fed9-4b80-be6f-794d8cf9fa1e" containerName="payload-processing" containerID="cri-o://6f64ad828f6df8a8b667c92560dd2667699a44dd7ff8b7002a821ced0519a041" gracePeriod=25
Oct 30 19:56:49.046639 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:56:49.046610    6015 logging.go:55] [core] [Channel #2386 SubChannel #2389]grpc: addrConn.createTransport failed to connect to {Addr: "10.134.0.86:50052", ServerName: "10.134.0.86:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.134.0.86:50052: connect: connection refused"
Oct 30 19:56:49.141849 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.141766    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l" podUID="56a49ad4-d50a-4d0c-9dfe-7d93b909c282" containerName="payload-pre-processing" containerID="cri-o://28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039" gracePeriod=25
Oct 30 19:56:49.206955 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.206867    6015 generic.go:356] "Generic (PLEG): container finished" podID="80e63d2f-fed9-4b80-be6f-794d8cf9fa1e" containerID="6f64ad828f6df8a8b667c92560dd2667699a44dd7ff8b7002a821ced0519a041" exitCode=0
Oct 30 19:56:49.206955 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.206931    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv" event={"ID":"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e","Type":"ContainerDied","Data":"6f64ad828f6df8a8b667c92560dd2667699a44dd7ff8b7002a821ced0519a041"}
Oct 30 19:56:49.234712 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.234674    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:49.313982 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.313950    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:56:49.386051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.386005    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:49.400995 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.400968    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-kube-api-access-r5h7l\" (UniqueName: \"kubernetes.io/projected/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-kube-api-access-r5h7l\") pod \"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e\" (UID: \"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e\") "
Oct 30 19:56:49.401183 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.401113    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-plugins-config-volume\") pod \"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e\" (UID: \"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e\") "
Oct 30 19:56:49.401493 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.401470    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-plugins-config-volume" pod "80e63d2f-fed9-4b80-be6f-794d8cf9fa1e" (UID: "80e63d2f-fed9-4b80-be6f-794d8cf9fa1e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:56:49.401674 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.401659    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:49.403432 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.403402    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-kube-api-access-r5h7l" pod "80e63d2f-fed9-4b80-be6f-794d8cf9fa1e" (UID: "80e63d2f-fed9-4b80-be6f-794d8cf9fa1e"). InnerVolumeSpecName "kube-api-access-r5h7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:56:49.415634 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.415611    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:56:49.502259 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.502223    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-kube-api-access-v9l4x\" (UniqueName: \"kubernetes.io/projected/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-kube-api-access-v9l4x\") pod \"56a49ad4-d50a-4d0c-9dfe-7d93b909c282\" (UID: \"56a49ad4-d50a-4d0c-9dfe-7d93b909c282\") "
Oct 30 19:56:49.502428 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.502323    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-plugins-config-volume\") pod \"56a49ad4-d50a-4d0c-9dfe-7d93b909c282\" (UID: \"56a49ad4-d50a-4d0c-9dfe-7d93b909c282\") "
Oct 30 19:56:49.502710 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.502686    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-plugins-config-volume" pod "56a49ad4-d50a-4d0c-9dfe-7d93b909c282" (UID: "56a49ad4-d50a-4d0c-9dfe-7d93b909c282"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:56:49.502791 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.502781    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5h7l\" (UniqueName: \"kubernetes.io/projected/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e-kube-api-access-r5h7l\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:49.504596 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.504572    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-kube-api-access-v9l4x" pod "56a49ad4-d50a-4d0c-9dfe-7d93b909c282" (UID: "56a49ad4-d50a-4d0c-9dfe-7d93b909c282"). InnerVolumeSpecName "kube-api-access-v9l4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:56:49.604951 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.604928    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:49.604951 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:49.604949    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9l4x\" (UniqueName: \"kubernetes.io/projected/56a49ad4-d50a-4d0c-9dfe-7d93b909c282-kube-api-access-v9l4x\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:56:50.046632 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.046571    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv" podUID="80e63d2f-fed9-4b80-be6f-794d8cf9fa1e" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.134.0.86:50052\" within 1s: context deadline exceeded"
Oct 30 19:56:50.214737 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.214706    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"
Oct 30 19:56:50.214943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.214743    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv" event={"ID":"80e63d2f-fed9-4b80-be6f-794d8cf9fa1e","Type":"ContainerDied","Data":"58d34885e26b6c993e68e0246d15c80f8bc77aa27c1dd69d5053ba452fc8600c"}
Oct 30 19:56:50.214943 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.214840    6015 scope.go:122] "RemoveContainer" containerID="6f64ad828f6df8a8b667c92560dd2667699a44dd7ff8b7002a821ced0519a041"
Oct 30 19:56:50.216253 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.216233    6015 generic.go:356] "Generic (PLEG): container finished" podID="56a49ad4-d50a-4d0c-9dfe-7d93b909c282" containerID="28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039" exitCode=0
Oct 30 19:56:50.216320 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.216272    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"
Oct 30 19:56:50.216320 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.216306    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l" event={"ID":"56a49ad4-d50a-4d0c-9dfe-7d93b909c282","Type":"ContainerDied","Data":"28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039"}
Oct 30 19:56:50.216421 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.216355    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l" event={"ID":"56a49ad4-d50a-4d0c-9dfe-7d93b909c282","Type":"ContainerDied","Data":"d3f07d08cd1ad6e88dbd656e5c23494e962f330300b4e7d9248b6729eefb2291"}
Oct 30 19:56:50.225583 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.225560    6015 scope.go:122] "RemoveContainer" containerID="28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039"
Oct 30 19:56:50.234917 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.234899    6015 scope.go:122] "RemoveContainer" containerID="28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039"
Oct 30 19:56:50.235230 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:56:50.235199    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039\": container with ID starting with 28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039 not found: ID does not exist" containerID="28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039"
Oct 30 19:56:50.235339 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.235240    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039"} err="failed to get container status \"28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039\": rpc error: code = NotFound desc = could not find container \"28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039\": container with ID starting with 28613be14f8d1694058e828b716dc12a5566b312f7b54e1232982a4d39a8f039 not found: ID does not exist"
Oct 30 19:56:50.379684 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.379577    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"]
Oct 30 19:56:50.379684 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.379649    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4b1a4c-5686c597c5-w424l"]
Oct 30 19:56:50.480072 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.480036    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"]
Oct 30 19:56:50.484452 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.484418    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4b1a4c-86b788bb5d-2c7wv"]
Oct 30 19:56:50.832083 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:50.832045    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:51.589170 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:51.589135    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56a49ad4-d50a-4d0c-9dfe-7d93b909c282" path="/var/lib/kubelet/pods/56a49ad4-d50a-4d0c-9dfe-7d93b909c282/volumes"
Oct 30 19:56:51.589591 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:51.589578    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80e63d2f-fed9-4b80-be6f-794d8cf9fa1e" path="/var/lib/kubelet/pods/80e63d2f-fed9-4b80-be6f-794d8cf9fa1e/volumes"
Oct 30 19:56:55.847520 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:55.847470    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:58.064638 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:58.064597    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:58.216594 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:56:58.216552    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:56:58.218670 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:58.218638    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:58.868447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:58.868405    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:56:59.017006 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:56:59.016967    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:00.837473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:00.837434    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:05.942628 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:05.942591    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:09.490047 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:09.490007    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"]
Oct 30 19:57:09.490486 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:09.490226    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy" containerID="cri-o://054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88" gracePeriod=30
Oct 30 19:57:09.939255 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:09.939193    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:11.466446 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:11.466398    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:13.843086 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:13.843043    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-5mm4g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 19:57:13.843493 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:13.843101    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:57:14.790234 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.790205    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:57:14.865171 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865129    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-data\") pod \"f089f140-7168-4c4c-a816-6c864dae4a63\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") "
Oct 30 19:57:14.865171 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865175    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-istio-token\" (UniqueName: \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-istio-token\") pod \"f089f140-7168-4c4c-a816-6c864dae4a63\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") "
Oct 30 19:57:14.865735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865215    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-socket\") pod \"f089f140-7168-4c4c-a816-6c864dae4a63\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") "
Oct 30 19:57:14.865735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865331    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-credential-socket\") pod \"f089f140-7168-4c4c-a816-6c864dae4a63\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") "
Oct 30 19:57:14.865735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865374    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f089f140-7168-4c4c-a816-6c864dae4a63-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f089f140-7168-4c4c-a816-6c864dae4a63-istio-podinfo\") pod \"f089f140-7168-4c4c-a816-6c864dae4a63\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") "
Oct 30 19:57:14.865735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865409    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-envoy\") pod \"f089f140-7168-4c4c-a816-6c864dae4a63\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") "
Oct 30 19:57:14.865735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865437    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f089f140-7168-4c4c-a816-6c864dae4a63-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f089f140-7168-4c4c-a816-6c864dae4a63-istiod-ca-cert\") pod \"f089f140-7168-4c4c-a816-6c864dae4a63\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") "
Oct 30 19:57:14.865735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865434    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-data" pod "f089f140-7168-4c4c-a816-6c864dae4a63" (UID: "f089f140-7168-4c4c-a816-6c864dae4a63"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:14.865735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865471    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-kube-api-access-bsvj8\" (UniqueName: \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-kube-api-access-bsvj8\") pod \"f089f140-7168-4c4c-a816-6c864dae4a63\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") "
Oct 30 19:57:14.865735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865536    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-socket" pod "f089f140-7168-4c4c-a816-6c864dae4a63" (UID: "f089f140-7168-4c4c-a816-6c864dae4a63"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:14.865735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865562    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-certs\") pod \"f089f140-7168-4c4c-a816-6c864dae4a63\" (UID: \"f089f140-7168-4c4c-a816-6c864dae4a63\") "
Oct 30 19:57:14.865735 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.865611    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-credential-socket" pod "f089f140-7168-4c4c-a816-6c864dae4a63" (UID: "f089f140-7168-4c4c-a816-6c864dae4a63"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:14.866261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.866019    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-certs" pod "f089f140-7168-4c4c-a816-6c864dae4a63" (UID: "f089f140-7168-4c4c-a816-6c864dae4a63"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:14.866261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.866093    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f089f140-7168-4c4c-a816-6c864dae4a63-istiod-ca-cert" pod "f089f140-7168-4c4c-a816-6c864dae4a63" (UID: "f089f140-7168-4c4c-a816-6c864dae4a63"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:57:14.866261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.866106    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:14.866261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.866143    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:14.866261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.866162    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:14.868147 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.868120    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-kube-api-access-bsvj8" pod "f089f140-7168-4c4c-a816-6c864dae4a63" (UID: "f089f140-7168-4c4c-a816-6c864dae4a63"). InnerVolumeSpecName "kube-api-access-bsvj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:14.868396 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.868365    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f089f140-7168-4c4c-a816-6c864dae4a63-istio-podinfo" pod "f089f140-7168-4c4c-a816-6c864dae4a63" (UID: "f089f140-7168-4c4c-a816-6c864dae4a63"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:57:14.868516 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.868420    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-envoy" pod "f089f140-7168-4c4c-a816-6c864dae4a63" (UID: "f089f140-7168-4c4c-a816-6c864dae4a63"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:14.868516 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.868439    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-istio-token" pod "f089f140-7168-4c4c-a816-6c864dae4a63" (UID: "f089f140-7168-4c4c-a816-6c864dae4a63"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:14.968270 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.968232    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f089f140-7168-4c4c-a816-6c864dae4a63-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:14.968270 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.968274    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:14.968534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.968288    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f089f140-7168-4c4c-a816-6c864dae4a63-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:14.968534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.968302    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsvj8\" (UniqueName: \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-kube-api-access-bsvj8\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:14.968534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.968315    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f089f140-7168-4c4c-a816-6c864dae4a63-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:14.968534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:14.968326    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f089f140-7168-4c4c-a816-6c864dae4a63-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:15.388879 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:15.388837    6015 generic.go:356] "Generic (PLEG): container finished" podID="f089f140-7168-4c4c-a816-6c864dae4a63" containerID="054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88" exitCode=0
Oct 30 19:57:15.389093 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:15.388898    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" event={"ID":"f089f140-7168-4c4c-a816-6c864dae4a63","Type":"ContainerDied","Data":"054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88"}
Oct 30 19:57:15.389093 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:15.388975    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g" event={"ID":"f089f140-7168-4c4c-a816-6c864dae4a63","Type":"ContainerDied","Data":"ca505a8783bd69ffd0026f4d03956ec609c371ff7ac77d682b0f87fec401718c"}
Oct 30 19:57:15.389093 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:15.388985    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"
Oct 30 19:57:15.389093 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:15.389000    6015 scope.go:122] "RemoveContainer" containerID="054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88"
Oct 30 19:57:15.401051 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:15.401022    6015 scope.go:122] "RemoveContainer" containerID="054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88"
Oct 30 19:57:15.401480 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:57:15.401450    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88\": container with ID starting with 054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88 not found: ID does not exist" containerID="054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88"
Oct 30 19:57:15.401608 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:15.401492    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88"} err="failed to get container status \"054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88\": rpc error: code = NotFound desc = could not find container \"054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88\": container with ID starting with 054b85548f5d848bb22b2a511e811fe3d535989c3cb555dcddd7fe3709f40c88 not found: ID does not exist"
Oct 30 19:57:15.547714 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:15.547682    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"]
Oct 30 19:57:15.593586 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:15.593549    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-5mm4g"]
Oct 30 19:57:16.067125 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.067030    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"]
Oct 30 19:57:16.067624 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.067308    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq" podUID="b5ede126-a103-4562-ad28-1d4086c140b2" containerName="maas-api" containerID="cri-o://412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3" gracePeriod=30
Oct 30 19:57:16.214072 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.214038    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:16.353609 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.353576    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:57:16.386949 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.386908    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-metrics-certs\") pod \"b5ede126-a103-4562-ad28-1d4086c140b2\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") "
Oct 30 19:57:16.387149 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.387103    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-maas-api-tls\") pod \"b5ede126-a103-4562-ad28-1d4086c140b2\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") "
Oct 30 19:57:16.387208 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.387179    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b5ede126-a103-4562-ad28-1d4086c140b2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5ede126-a103-4562-ad28-1d4086c140b2-openshift-service-ca\") pod \"b5ede126-a103-4562-ad28-1d4086c140b2\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") "
Oct 30 19:57:16.387309 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.387290    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5ede126-a103-4562-ad28-1d4086c140b2-kube-api-access-rtwzl\" (UniqueName: \"kubernetes.io/projected/b5ede126-a103-4562-ad28-1d4086c140b2-kube-api-access-rtwzl\") pod \"b5ede126-a103-4562-ad28-1d4086c140b2\" (UID: \"b5ede126-a103-4562-ad28-1d4086c140b2\") "
Oct 30 19:57:16.388020 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.387589    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5ede126-a103-4562-ad28-1d4086c140b2-openshift-service-ca" pod "b5ede126-a103-4562-ad28-1d4086c140b2" (UID: "b5ede126-a103-4562-ad28-1d4086c140b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:57:16.388170 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.388043    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5ede126-a103-4562-ad28-1d4086c140b2-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:16.390948 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.390923    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-maas-api-tls" pod "b5ede126-a103-4562-ad28-1d4086c140b2" (UID: "b5ede126-a103-4562-ad28-1d4086c140b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:57:16.391054 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.390951    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-metrics-certs" pod "b5ede126-a103-4562-ad28-1d4086c140b2" (UID: "b5ede126-a103-4562-ad28-1d4086c140b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:57:16.391054 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.390968    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ede126-a103-4562-ad28-1d4086c140b2-kube-api-access-rtwzl" pod "b5ede126-a103-4562-ad28-1d4086c140b2" (UID: "b5ede126-a103-4562-ad28-1d4086c140b2"). InnerVolumeSpecName "kube-api-access-rtwzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:16.400361 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.400331    6015 generic.go:356] "Generic (PLEG): container finished" podID="b5ede126-a103-4562-ad28-1d4086c140b2" containerID="412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3" exitCode=0
Oct 30 19:57:16.400534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.400383    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"
Oct 30 19:57:16.400534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.400457    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq" event={"ID":"b5ede126-a103-4562-ad28-1d4086c140b2","Type":"ContainerDied","Data":"412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3"}
Oct 30 19:57:16.400534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.400511    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq" event={"ID":"b5ede126-a103-4562-ad28-1d4086c140b2","Type":"ContainerDied","Data":"4d05f1b8e7cf38badd942a0f78a32e2ea846cc5afc09ef76eafe7b00af5ba084"}
Oct 30 19:57:16.400534 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.400533    6015 scope.go:122] "RemoveContainer" containerID="412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3"
Oct 30 19:57:16.419385 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.419358    6015 scope.go:122] "RemoveContainer" containerID="412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3"
Oct 30 19:57:16.419688 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:57:16.419669    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3\": container with ID starting with 412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3 not found: ID does not exist" containerID="412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3"
Oct 30 19:57:16.419743 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.419699    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3"} err="failed to get container status \"412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3\": rpc error: code = NotFound desc = could not find container \"412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3\": container with ID starting with 412d7cd5bbe05140f933f4975cb568eef881c1f6f3e4a138279903d8c748c4c3 not found: ID does not exist"
Oct 30 19:57:16.489470 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.489439    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:16.489470 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.489467    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5ede126-a103-4562-ad28-1d4086c140b2-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:16.489470 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.489477    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtwzl\" (UniqueName: \"kubernetes.io/projected/b5ede126-a103-4562-ad28-1d4086c140b2-kube-api-access-rtwzl\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:16.610460 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.610373    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"]
Oct 30 19:57:16.615128 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:16.615100    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-111f9c64-6d698d5fc6-tsgjq"]
Oct 30 19:57:17.587836 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:17.587755    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:17.591022 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:17.590993    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b5ede126-a103-4562-ad28-1d4086c140b2" path="/var/lib/kubelet/pods/b5ede126-a103-4562-ad28-1d4086c140b2/volumes"
Oct 30 19:57:17.591544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:17.591523    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" path="/var/lib/kubelet/pods/f089f140-7168-4c4c-a816-6c864dae4a63/volumes"
Oct 30 19:57:17.931381 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:17.931288    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:18.261630 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:18.261540    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:18.979506 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:18.979464    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:19.388315 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:19.388279    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:19.694601 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:19.694509    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:20.323338 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:20.323305    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:20.608190 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:20.608092    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:21.020994 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:21.020899    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:21.173405 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:21.173371    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:21.632306 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:21.632255    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:22.316474 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:22.316436    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:23.383207 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:23.383164    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:23.539965 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:23.539377    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:24.467928 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:24.467873    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:26.503348 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:26.503290    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:26.673023 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:26.672979    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:26.853665 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:26.853615    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:27.012798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:27.012747    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:28.217459 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:57:28.217421    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:57:28.672442 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:28.672395    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:28.830087 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:28.830051    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:29.011026 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:29.010888    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:30.452012 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:30.451973    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:30.653290 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:30.653255    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:31.904128 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:31.904095    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:32.952499 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:32.952467    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:33.154229 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:33.154194    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:33.985954 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:33.985920    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:34.196067 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:34.196032    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:37.410392 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:37.410353    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:41.762393 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:41.762353    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:41.914641 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:41.914606    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:42.403760 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:42.403724    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:47.491434 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:47.491395    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:49.610261 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:49.610209    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:51.574143 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:51.574103    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"]
Oct 30 19:57:51.574669 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:51.574397    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy" containerID="cri-o://e34de0779cec1e30fb0f9876ee78ce2289cf1b2af9489c4e22add66740a34ea4" gracePeriod=30
Oct 30 19:57:52.538242 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:52.538201    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:52.855210 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:52.855170    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"]
Oct 30 19:57:52.855729 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:52.855403    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerName="istio-proxy" containerID="cri-o://162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7" gracePeriod=30
Oct 30 19:57:52.904522 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:52.904484    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"]
Oct 30 19:57:52.905017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:52.904986    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerName="istio-proxy" containerID="cri-o://291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc" gracePeriod=30
Oct 30 19:57:53.686358 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:53.686318    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"]
Oct 30 19:57:53.686887 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:53.686857    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" podUID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" containerName="istio-proxy" containerID="cri-o://88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff" gracePeriod=30
Oct 30 19:57:55.712833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:55.712778    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 19:57:55.713221 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:55.712873    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:57:56.062416 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.062380    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 19:57:56.062588 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.062449    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:57:56.752368 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.752335    6015 generic.go:356] "Generic (PLEG): container finished" podID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerID="e34de0779cec1e30fb0f9876ee78ce2289cf1b2af9489c4e22add66740a34ea4" exitCode=0
Oct 30 19:57:56.752884 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.752432    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" event={"ID":"04256a40-3e15-4ed9-be3e-ec7aa0c882e4","Type":"ContainerDied","Data":"e34de0779cec1e30fb0f9876ee78ce2289cf1b2af9489c4e22add66740a34ea4"}
Oct 30 19:57:56.752884 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.752498    6015 scope.go:122] "RemoveContainer" containerID="6216f09f6f1cab5d21904fc02ca912482d4326f6b757e87aa13781e045549e4a"
Oct 30 19:57:56.864159 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.864132    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:57:56.871885 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.871854    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-kube-api-access-zgm8p\" (UniqueName: \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-kube-api-access-zgm8p\") pod \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") "
Oct 30 19:57:56.872078 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.871937    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-podinfo\") pod \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") "
Oct 30 19:57:56.872078 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.871960    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-credential-socket\") pod \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") "
Oct 30 19:57:56.872078 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.871996    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-socket\") pod \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") "
Oct 30 19:57:56.872078 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.872054    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-data\") pod \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") "
Oct 30 19:57:56.872299 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.872099    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-token\" (UniqueName: \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-token\") pod \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") "
Oct 30 19:57:56.872299 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.872138    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istiod-ca-cert\") pod \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") "
Oct 30 19:57:56.872410 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.872286    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-credential-socket" pod "04256a40-3e15-4ed9-be3e-ec7aa0c882e4" (UID: "04256a40-3e15-4ed9-be3e-ec7aa0c882e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:56.872410 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.872375    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-socket" pod "04256a40-3e15-4ed9-be3e-ec7aa0c882e4" (UID: "04256a40-3e15-4ed9-be3e-ec7aa0c882e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:56.872410 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.872386    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-envoy\") pod \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") "
Oct 30 19:57:56.872576 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.872447    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-certs\") pod \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\" (UID: \"04256a40-3e15-4ed9-be3e-ec7aa0c882e4\") "
Oct 30 19:57:56.872637 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.872603    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istiod-ca-cert" pod "04256a40-3e15-4ed9-be3e-ec7aa0c882e4" (UID: "04256a40-3e15-4ed9-be3e-ec7aa0c882e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:57:56.872719 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.872689    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-data" pod "04256a40-3e15-4ed9-be3e-ec7aa0c882e4" (UID: "04256a40-3e15-4ed9-be3e-ec7aa0c882e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:56.872980 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.872878    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-certs" pod "04256a40-3e15-4ed9-be3e-ec7aa0c882e4" (UID: "04256a40-3e15-4ed9-be3e-ec7aa0c882e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:56.873464 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.873436    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:56.873562 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.873468    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:56.873562 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.873489    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:56.873562 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.873503    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:56.873562 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.873520    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:56.874559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.874527    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-podinfo" pod "04256a40-3e15-4ed9-be3e-ec7aa0c882e4" (UID: "04256a40-3e15-4ed9-be3e-ec7aa0c882e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:57:56.874685 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.874659    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-token" pod "04256a40-3e15-4ed9-be3e-ec7aa0c882e4" (UID: "04256a40-3e15-4ed9-be3e-ec7aa0c882e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:56.874964 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.874941    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-kube-api-access-zgm8p" pod "04256a40-3e15-4ed9-be3e-ec7aa0c882e4" (UID: "04256a40-3e15-4ed9-be3e-ec7aa0c882e4"). InnerVolumeSpecName "kube-api-access-zgm8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:56.875031 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.874966    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-envoy" pod "04256a40-3e15-4ed9-be3e-ec7aa0c882e4" (UID: "04256a40-3e15-4ed9-be3e-ec7aa0c882e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:56.974554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.974516    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:56.974554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.974549    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgm8p\" (UniqueName: \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-kube-api-access-zgm8p\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:56.974554 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.974560    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:56.974819 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:56.974569    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04256a40-3e15-4ed9-be3e-ec7aa0c882e4-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:57.759842 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:57.759784    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968" event={"ID":"04256a40-3e15-4ed9-be3e-ec7aa0c882e4","Type":"ContainerDied","Data":"b7beb16943103ccf0ed61631ea75ab5f8e13d78803c7414a3901011980e6e052"}
Oct 30 19:57:57.760295 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:57.759848    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"
Oct 30 19:57:57.760295 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:57.759867    6015 scope.go:122] "RemoveContainer" containerID="e34de0779cec1e30fb0f9876ee78ce2289cf1b2af9489c4e22add66740a34ea4"
Oct 30 19:57:57.816167 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:57.816114    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:57:57.966002 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:57.965973    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"]
Oct 30 19:57:58.012492 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.012430    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mx968"]
Oct 30 19:57:58.196861 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.196833    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:57:58.218556 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.218528    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:57:58.219525 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:57:58.219497    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:57:58.295680 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.295644    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-token\" (UniqueName: \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-token\") pod \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") "
Oct 30 19:57:58.295936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.295700    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-envoy\") pod \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") "
Oct 30 19:57:58.295936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.295731    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-podinfo\") pod \"017278f7-1f6f-490e-9a81-03a1ce84c448\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") "
Oct 30 19:57:58.295936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.295767    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-certs\") pod \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") "
Oct 30 19:57:58.295936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.295863    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-kube-api-access-mkdjt\" (UniqueName: \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-kube-api-access-mkdjt\") pod \"017278f7-1f6f-490e-9a81-03a1ce84c448\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") "
Oct 30 19:57:58.295936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.295905    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/017278f7-1f6f-490e-9a81-03a1ce84c448-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/017278f7-1f6f-490e-9a81-03a1ce84c448-istiod-ca-cert\") pod \"017278f7-1f6f-490e-9a81-03a1ce84c448\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") "
Oct 30 19:57:58.295936 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.295938    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-token\" (UniqueName: \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-token\") pod \"017278f7-1f6f-490e-9a81-03a1ce84c448\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") "
Oct 30 19:57:58.296268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.295971    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-credential-socket\") pod \"017278f7-1f6f-490e-9a81-03a1ce84c448\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") "
Oct 30 19:57:58.296268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296019    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-socket\") pod \"017278f7-1f6f-490e-9a81-03a1ce84c448\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") "
Oct 30 19:57:58.296268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296051    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-data\") pod \"017278f7-1f6f-490e-9a81-03a1ce84c448\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") "
Oct 30 19:57:58.296268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296082    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-kube-api-access-lk9b5\" (UniqueName: \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-kube-api-access-lk9b5\") pod \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") "
Oct 30 19:57:58.296268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296132    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-socket\") pod \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") "
Oct 30 19:57:58.296268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296169    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-credential-socket\") pod \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") "
Oct 30 19:57:58.296548 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296281    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-certs\") pod \"017278f7-1f6f-490e-9a81-03a1ce84c448\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") "
Oct 30 19:57:58.296548 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296316    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-data\") pod \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") "
Oct 30 19:57:58.296548 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296326    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-socket" pod "017278f7-1f6f-490e-9a81-03a1ce84c448" (UID: "017278f7-1f6f-490e-9a81-03a1ce84c448"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:58.296548 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296342    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-podinfo\") pod \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") "
Oct 30 19:57:58.296548 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296370    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/017278f7-1f6f-490e-9a81-03a1ce84c448-istiod-ca-cert" pod "017278f7-1f6f-490e-9a81-03a1ce84c448" (UID: "017278f7-1f6f-490e-9a81-03a1ce84c448"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:57:58.296548 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296476    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istiod-ca-cert\") pod \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\" (UID: \"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2\") "
Oct 30 19:57:58.297006 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296553    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-envoy\") pod \"017278f7-1f6f-490e-9a81-03a1ce84c448\" (UID: \"017278f7-1f6f-490e-9a81-03a1ce84c448\") "
Oct 30 19:57:58.297006 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296857    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-credential-socket" pod "017278f7-1f6f-490e-9a81-03a1ce84c448" (UID: "017278f7-1f6f-490e-9a81-03a1ce84c448"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:58.297006 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.296895    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-certs" pod "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" (UID: "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:58.297212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.297057    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-data" pod "017278f7-1f6f-490e-9a81-03a1ce84c448" (UID: "017278f7-1f6f-490e-9a81-03a1ce84c448"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:58.297212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.297092    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-socket" pod "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" (UID: "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:58.298749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.297634    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.298749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.297663    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/017278f7-1f6f-490e-9a81-03a1ce84c448-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.298749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.297679    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.298749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.297693    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.298749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.297709    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.298749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.297724    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.298749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.297975    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-certs" pod "017278f7-1f6f-490e-9a81-03a1ce84c448" (UID: "017278f7-1f6f-490e-9a81-03a1ce84c448"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:58.298749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.298165    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-credential-socket" pod "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" (UID: "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:58.298749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.298481    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istiod-ca-cert" pod "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" (UID: "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:57:58.299221 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.298763    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-data" pod "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" (UID: "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:58.299221 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.298932    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-podinfo" pod "017278f7-1f6f-490e-9a81-03a1ce84c448" (UID: "017278f7-1f6f-490e-9a81-03a1ce84c448"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:57:58.299221 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.298934    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-podinfo" pod "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" (UID: "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:57:58.299605 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.299576    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-kube-api-access-mkdjt" pod "017278f7-1f6f-490e-9a81-03a1ce84c448" (UID: "017278f7-1f6f-490e-9a81-03a1ce84c448"). InnerVolumeSpecName "kube-api-access-mkdjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:58.299705 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.299605    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-envoy" pod "017278f7-1f6f-490e-9a81-03a1ce84c448" (UID: "017278f7-1f6f-490e-9a81-03a1ce84c448"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:58.299705 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.299615    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-token" pod "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" (UID: "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:58.299705 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.299619    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-envoy" pod "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" (UID: "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:58.299968 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.299952    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-token" pod "017278f7-1f6f-490e-9a81-03a1ce84c448" (UID: "017278f7-1f6f-490e-9a81-03a1ce84c448"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:58.300344 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.300326    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-kube-api-access-lk9b5" pod "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" (UID: "5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2"). InnerVolumeSpecName "kube-api-access-lk9b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:58.398856 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398733    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.398856 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398764    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.398856 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398778    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.398856 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398793    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.398856 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398822    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.398856 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398836    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.398856 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398848    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.398856 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398860    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.399291 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398875    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkdjt\" (UniqueName: \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-kube-api-access-mkdjt\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.399291 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398889    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/017278f7-1f6f-490e-9a81-03a1ce84c448-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.399291 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398898    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk9b5\" (UniqueName: \"kubernetes.io/projected/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-kube-api-access-lk9b5\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.399291 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.398906    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:58.768885 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.768847    6015 generic.go:356] "Generic (PLEG): container finished" podID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerID="291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc" exitCode=0
Oct 30 19:57:58.768885 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.768908    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"
Oct 30 19:57:58.769490 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.768930    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" event={"ID":"017278f7-1f6f-490e-9a81-03a1ce84c448","Type":"ContainerDied","Data":"291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc"}
Oct 30 19:57:58.769490 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.769000    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj" event={"ID":"017278f7-1f6f-490e-9a81-03a1ce84c448","Type":"ContainerDied","Data":"1411bc2b79926eb57c014169fe3a37bcd328877158364febb3c26c6f8ead6090"}
Oct 30 19:57:58.769490 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.769033    6015 scope.go:122] "RemoveContainer" containerID="291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc"
Oct 30 19:57:58.771233 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.771202    6015 generic.go:356] "Generic (PLEG): container finished" podID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerID="162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7" exitCode=0
Oct 30 19:57:58.771386 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.771265    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"
Oct 30 19:57:58.771386 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.771324    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" event={"ID":"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2","Type":"ContainerDied","Data":"162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7"}
Oct 30 19:57:58.771544 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.771392    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm" event={"ID":"5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2","Type":"ContainerDied","Data":"8897e1670e9b6871daf64ce3b295146f8d6f196ad535948aedea7be02026e555"}
Oct 30 19:57:58.801944 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.801918    6015 scope.go:122] "RemoveContainer" containerID="291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc"
Oct 30 19:57:58.802395 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:57:58.802364    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc\": container with ID starting with 291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc not found: ID does not exist" containerID="291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc"
Oct 30 19:57:58.802494 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.802408    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc"} err="failed to get container status \"291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc\": rpc error: code = NotFound desc = could not find container \"291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc\": container with ID starting with 291de5877069b8cbab496ac17eb0e64d4fa110463e94afec801d692dd373b1fc not found: ID does not exist"
Oct 30 19:57:58.802494 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.802435    6015 scope.go:122] "RemoveContainer" containerID="162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7"
Oct 30 19:57:58.814127 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.814098    6015 scope.go:122] "RemoveContainer" containerID="162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7"
Oct 30 19:57:58.814545 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:57:58.814515    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7\": container with ID starting with 162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7 not found: ID does not exist" containerID="162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7"
Oct 30 19:57:58.814615 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.814563    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7"} err="failed to get container status \"162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7\": rpc error: code = NotFound desc = could not find container \"162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7\": container with ID starting with 162117f2c62ffe15998ec187ada609a12e16044acbea5e9ee2613b942b2126b7 not found: ID does not exist"
Oct 30 19:57:58.932480 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.932438    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"]
Oct 30 19:57:58.977098 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.976929    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-lkggj"]
Oct 30 19:57:58.996400 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:58.996368    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:57:59.038436 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.038401    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"]
Oct 30 19:57:59.044800 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.044764    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-rvjlm"]
Oct 30 19:57:59.107825 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.107766    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istiod-ca-cert\") pod \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") "
Oct 30 19:57:59.108008 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.107907    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-credential-socket\") pod \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") "
Oct 30 19:57:59.108008 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.107988    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-data\") pod \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") "
Oct 30 19:57:59.108113 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108026    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-envoy\") pod \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") "
Oct 30 19:57:59.108113 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108062    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-token\" (UniqueName: \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-token\") pod \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") "
Oct 30 19:57:59.108212 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108151    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-podinfo\") pod \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") "
Oct 30 19:57:59.108270 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108217    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-certs\") pod \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") "
Oct 30 19:57:59.108270 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108230    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istiod-ca-cert" pod "75e26bd4-2c07-49cf-b1a2-6773058e7a83" (UID: "75e26bd4-2c07-49cf-b1a2-6773058e7a83"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:57:59.108270 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108238    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-credential-socket" pod "75e26bd4-2c07-49cf-b1a2-6773058e7a83" (UID: "75e26bd4-2c07-49cf-b1a2-6773058e7a83"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:59.108490 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108273    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-socket\") pod \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") "
Oct 30 19:57:59.108490 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108307    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-data" pod "75e26bd4-2c07-49cf-b1a2-6773058e7a83" (UID: "75e26bd4-2c07-49cf-b1a2-6773058e7a83"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:59.108490 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108343    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-kube-api-access-52fp2\" (UniqueName: \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-kube-api-access-52fp2\") pod \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\" (UID: \"75e26bd4-2c07-49cf-b1a2-6773058e7a83\") "
Oct 30 19:57:59.108660 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108536    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-certs" pod "75e26bd4-2c07-49cf-b1a2-6773058e7a83" (UID: "75e26bd4-2c07-49cf-b1a2-6773058e7a83"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:59.108917 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108890    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-socket" pod "75e26bd4-2c07-49cf-b1a2-6773058e7a83" (UID: "75e26bd4-2c07-49cf-b1a2-6773058e7a83"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:59.109192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108915    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:59.109192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108941    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:59.109192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108960    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:59.109192 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.108973    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:59.110860 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.110779    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-podinfo" pod "75e26bd4-2c07-49cf-b1a2-6773058e7a83" (UID: "75e26bd4-2c07-49cf-b1a2-6773058e7a83"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:57:59.110860 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.110853    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-kube-api-access-52fp2" pod "75e26bd4-2c07-49cf-b1a2-6773058e7a83" (UID: "75e26bd4-2c07-49cf-b1a2-6773058e7a83"). InnerVolumeSpecName "kube-api-access-52fp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:59.111102 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.111083    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-envoy" pod "75e26bd4-2c07-49cf-b1a2-6773058e7a83" (UID: "75e26bd4-2c07-49cf-b1a2-6773058e7a83"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:57:59.111164 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.111102    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-token" pod "75e26bd4-2c07-49cf-b1a2-6773058e7a83" (UID: "75e26bd4-2c07-49cf-b1a2-6773058e7a83"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:57:59.210740 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.210698    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:59.210740 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.210730    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:59.210740 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.210741    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75e26bd4-2c07-49cf-b1a2-6773058e7a83-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:59.210740 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.210750    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75e26bd4-2c07-49cf-b1a2-6773058e7a83-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:59.211042 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.210760    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52fp2\" (UniqueName: \"kubernetes.io/projected/75e26bd4-2c07-49cf-b1a2-6773058e7a83-kube-api-access-52fp2\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:57:59.586587 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.586548    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" path="/var/lib/kubelet/pods/017278f7-1f6f-490e-9a81-03a1ce84c448/volumes"
Oct 30 19:57:59.587297 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.587276    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" path="/var/lib/kubelet/pods/04256a40-3e15-4ed9-be3e-ec7aa0c882e4/volumes"
Oct 30 19:57:59.587963 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.587944    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" path="/var/lib/kubelet/pods/5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2/volumes"
Oct 30 19:57:59.780761 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.780718    6015 generic.go:356] "Generic (PLEG): container finished" podID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" containerID="88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff" exitCode=0
Oct 30 19:57:59.781209 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.780774    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"
Oct 30 19:57:59.781209 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.780845    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" event={"ID":"75e26bd4-2c07-49cf-b1a2-6773058e7a83","Type":"ContainerDied","Data":"88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff"}
Oct 30 19:57:59.781209 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.780932    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n" event={"ID":"75e26bd4-2c07-49cf-b1a2-6773058e7a83","Type":"ContainerDied","Data":"6aec53d89da3e43492976e0194abb13374c4f087d51d8ddf6d1d843721e6492b"}
Oct 30 19:57:59.781209 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.780967    6015 scope.go:122] "RemoveContainer" containerID="88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff"
Oct 30 19:57:59.791715 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.791690    6015 scope.go:122] "RemoveContainer" containerID="88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff"
Oct 30 19:57:59.792054 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:57:59.792033    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff\": container with ID starting with 88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff not found: ID does not exist" containerID="88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff"
Oct 30 19:57:59.792114 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.792062    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff"} err="failed to get container status \"88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff\": rpc error: code = NotFound desc = could not find container \"88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff\": container with ID starting with 88c0cf6911e0e7277211ce3bdf3b1ac64ce8ca4ccabb2b86d17b3d5787efaeff not found: ID does not exist"
Oct 30 19:57:59.940209 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.940097    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"]
Oct 30 19:57:59.949942 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:57:59.949908    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-dw29n"]
Oct 30 19:58:01.585903 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:01.585862    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" path="/var/lib/kubelet/pods/75e26bd4-2c07-49cf-b1a2-6773058e7a83/volumes"
Oct 30 19:58:02.829599 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:02.829557    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:03.038469 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:03.038429    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:03.215188 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:03.215100    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:08.112522 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:08.112482    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:12.508832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:12.508036    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"]
Oct 30 19:58:12.521830 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:12.508660    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2" podUID="e838e013-fe73-4e68-8071-b552d8aa6943" containerName="maas-api" containerID="cri-o://3321fe1ed171d1cd000f2697d6351c9c429fb6c57bdce9f35b2f5952ad5a3bf0" gracePeriod=30
Oct 30 19:58:12.647282 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:12.647245    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:12.884666 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:12.884626    6015 generic.go:356] "Generic (PLEG): container finished" podID="e838e013-fe73-4e68-8071-b552d8aa6943" containerID="3321fe1ed171d1cd000f2697d6351c9c429fb6c57bdce9f35b2f5952ad5a3bf0" exitCode=0
Oct 30 19:58:12.885019 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:12.884992    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2" event={"ID":"e838e013-fe73-4e68-8071-b552d8aa6943","Type":"ContainerDied","Data":"3321fe1ed171d1cd000f2697d6351c9c429fb6c57bdce9f35b2f5952ad5a3bf0"}
Oct 30 19:58:12.960732 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:12.960703    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:58:13.123833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.120343    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e838e013-fe73-4e68-8071-b552d8aa6943-kube-api-access-58f96\" (UniqueName: \"kubernetes.io/projected/e838e013-fe73-4e68-8071-b552d8aa6943-kube-api-access-58f96\") pod \"e838e013-fe73-4e68-8071-b552d8aa6943\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") "
Oct 30 19:58:13.123833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.120412    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-metrics-certs\") pod \"e838e013-fe73-4e68-8071-b552d8aa6943\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") "
Oct 30 19:58:13.123833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.120445    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-maas-api-tls\") pod \"e838e013-fe73-4e68-8071-b552d8aa6943\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") "
Oct 30 19:58:13.123833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.120591    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e838e013-fe73-4e68-8071-b552d8aa6943-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e838e013-fe73-4e68-8071-b552d8aa6943-openshift-service-ca\") pod \"e838e013-fe73-4e68-8071-b552d8aa6943\" (UID: \"e838e013-fe73-4e68-8071-b552d8aa6943\") "
Oct 30 19:58:13.123833 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.121797    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e838e013-fe73-4e68-8071-b552d8aa6943-openshift-service-ca" pod "e838e013-fe73-4e68-8071-b552d8aa6943" (UID: "e838e013-fe73-4e68-8071-b552d8aa6943"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:58:13.143466 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.143421    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-maas-api-tls" pod "e838e013-fe73-4e68-8071-b552d8aa6943" (UID: "e838e013-fe73-4e68-8071-b552d8aa6943"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:58:13.143798 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.143772    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e838e013-fe73-4e68-8071-b552d8aa6943-kube-api-access-58f96" pod "e838e013-fe73-4e68-8071-b552d8aa6943" (UID: "e838e013-fe73-4e68-8071-b552d8aa6943"). InnerVolumeSpecName "kube-api-access-58f96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:58:13.145910 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.145874    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-metrics-certs" pod "e838e013-fe73-4e68-8071-b552d8aa6943" (UID: "e838e013-fe73-4e68-8071-b552d8aa6943"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:58:13.222676 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.222346    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e838e013-fe73-4e68-8071-b552d8aa6943-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:13.222676 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.222390    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58f96\" (UniqueName: \"kubernetes.io/projected/e838e013-fe73-4e68-8071-b552d8aa6943-kube-api-access-58f96\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:13.222676 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.222409    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:13.222676 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.222422    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e838e013-fe73-4e68-8071-b552d8aa6943-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:13.893201 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.893114    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"
Oct 30 19:58:13.893201 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.893149    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2" event={"ID":"e838e013-fe73-4e68-8071-b552d8aa6943","Type":"ContainerDied","Data":"712dfb26e519eceffea4d3a59d2c68d743e5f1c64bc00d169f18c733879c7cb7"}
Oct 30 19:58:13.893728 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:13.893213    6015 scope.go:122] "RemoveContainer" containerID="3321fe1ed171d1cd000f2697d6351c9c429fb6c57bdce9f35b2f5952ad5a3bf0"
Oct 30 19:58:14.050764 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:14.050723    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"]
Oct 30 19:58:14.097313 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:14.097271    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4b1a4c-9bfff74bd-qmkf2"]
Oct 30 19:58:14.381100 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:14.381052    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:14.602268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:14.602224    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:14.752446 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:14.752351    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:15.362354 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:15.362318    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:15.586692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:15.586654    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e838e013-fe73-4e68-8071-b552d8aa6943" path="/var/lib/kubelet/pods/e838e013-fe73-4e68-8071-b552d8aa6943/volumes"
Oct 30 19:58:19.009281 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.009248    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:19.534390 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.534357    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"]
Oct 30 19:58:19.535023 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535005    6015 cpu_manager.go:414] "containerMap: removing container" podUID="e838e013-fe73-4e68-8071-b552d8aa6943" containerName="maas-api"
Oct 30 19:58:19.535088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535026    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e838e013-fe73-4e68-8071-b552d8aa6943" containerName="maas-api"
Oct 30 19:58:19.535088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535042    6015 cpu_manager.go:414] "containerMap: removing container" podUID="80e63d2f-fed9-4b80-be6f-794d8cf9fa1e" containerName="payload-processing"
Oct 30 19:58:19.535088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535051    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80e63d2f-fed9-4b80-be6f-794d8cf9fa1e" containerName="payload-processing"
Oct 30 19:58:19.535088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535070    6015 cpu_manager.go:414] "containerMap: removing container" podUID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" containerName="istio-proxy"
Oct 30 19:58:19.535088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535075    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" containerName="istio-proxy"
Oct 30 19:58:19.535088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535082    6015 cpu_manager.go:414] "containerMap: removing container" podUID="56a49ad4-d50a-4d0c-9dfe-7d93b909c282" containerName="payload-pre-processing"
Oct 30 19:58:19.535088 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535086    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56a49ad4-d50a-4d0c-9dfe-7d93b909c282" containerName="payload-pre-processing"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535097    6015 cpu_manager.go:414] "containerMap: removing container" podUID="09422e2a-dfe9-42f3-8420-57fbbc15c0de" containerName="maas-api"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535102    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09422e2a-dfe9-42f3-8420-57fbbc15c0de" containerName="maas-api"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535110    6015 cpu_manager.go:414] "containerMap: removing container" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535115    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535122    6015 cpu_manager.go:414] "containerMap: removing container" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535131    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535144    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5c8770f9-b6b3-4db7-ba7d-66406bd7c936" containerName="maas-api"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535149    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c8770f9-b6b3-4db7-ba7d-66406bd7c936" containerName="maas-api"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535160    6015 cpu_manager.go:414] "containerMap: removing container" podUID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535164    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535170    6015 cpu_manager.go:414] "containerMap: removing container" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535174    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535184    6015 cpu_manager.go:414] "containerMap: removing container" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535188    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535194    6015 cpu_manager.go:414] "containerMap: removing container" podUID="b5ede126-a103-4562-ad28-1d4086c140b2" containerName="maas-api"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535199    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5ede126-a103-4562-ad28-1d4086c140b2" containerName="maas-api"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535216    6015 cpu_manager.go:414] "containerMap: removing container" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535222    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535228    6015 cpu_manager.go:414] "containerMap: removing container" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535232    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535241    6015 cpu_manager.go:414] "containerMap: removing container" podUID="b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea" containerName="payload-processing"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535245    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea" containerName="payload-processing"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535255    6015 cpu_manager.go:414] "containerMap: removing container" podUID="2d1dc762-cde5-4a68-9572-145675e60f8b" containerName="payload-pre-processing"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535259    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d1dc762-cde5-4a68-9572-145675e60f8b" containerName="payload-pre-processing"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535270    6015 cpu_manager.go:414] "containerMap: removing container" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535277    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535286    6015 cpu_manager.go:414] "containerMap: removing container" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535293    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535310    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerName="istio-proxy"
Oct 30 19:58:19.535327 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535315    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535421    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="80e63d2f-fed9-4b80-be6f-794d8cf9fa1e" containerName="payload-processing"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535434    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="67b1bbbb-c9d8-44e1-8ce8-1f506aa2123d" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535440    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="56a49ad4-d50a-4d0c-9dfe-7d93b909c282" containerName="payload-pre-processing"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535452    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="09422e2a-dfe9-42f3-8420-57fbbc15c0de" containerName="maas-api"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535462    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="017278f7-1f6f-490e-9a81-03a1ce84c448" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535469    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="0fca59b7-1f91-4633-910e-688571b7abd3" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535476    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c8770f9-b6b3-4db7-ba7d-66406bd7c936" containerName="maas-api"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535483    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="75e26bd4-2c07-49cf-b1a2-6773058e7a83" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535487    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535493    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="29ff0b74-8ca4-4b0d-a453-f86fe5a240a2" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535499    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5ede126-a103-4562-ad28-1d4086c140b2" containerName="maas-api"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535504    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="c728de5a-3379-49dc-9c6b-9453ded4a93f" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535509    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="04256a40-3e15-4ed9-be3e-ec7aa0c882e4" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535515    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0bc0d6d-e74e-419d-96fd-9e7c01dac6ea" containerName="payload-processing"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535522    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d1dc762-cde5-4a68-9572-145675e60f8b" containerName="payload-pre-processing"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535530    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="f089f140-7168-4c4c-a816-6c864dae4a63" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535538    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e9d69e8-4d02-4d58-ae67-67d545aceffa" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535546    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b9b6e9a-6dce-4266-8cdc-c8f1fb8741e2" containerName="istio-proxy"
Oct 30 19:58:19.536614 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.535551    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="e838e013-fe73-4e68-8071-b552d8aa6943" containerName="maas-api"
Oct 30 19:58:19.540760 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.540739    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.609872 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.591253    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-d80c7d-openshift-default-dockercfg-r92ch\""
Oct 30 19:58:19.647685 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.647645    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"]
Oct 30 19:58:19.648800 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.648762    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:19.709220 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.709178    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-credential-socket\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.709429 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.709224    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-data\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.709429 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.709262    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-podinfo\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.709429 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.709299    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d8df69-ea03-48d6-827b-4307d06caad6-istiod-ca-cert\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.709429 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.709333    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-envoy\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.709429 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.709362    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-socket\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.709429 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.709399    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6wv2\" (UniqueName: \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-kube-api-access-c6wv2\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.709741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.709553    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-certs\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.709741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.709606    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-token\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.811392 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.811356    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-certs\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.811595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.811418    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-token\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.811595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.811525    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-credential-socket\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.811595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.811558    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-data\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.811595 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.811590    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-podinfo\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.811864 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.811630    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d8df69-ea03-48d6-827b-4307d06caad6-istiod-ca-cert\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.811864 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.811664    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-envoy\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.811864 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.811695    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-socket\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.811864 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.811740    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6wv2\" (UniqueName: \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-kube-api-access-c6wv2\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.811864 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.811845    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-certs\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.812113 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.811945    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-credential-socket\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.812211 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.812190    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-socket\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.812263 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.812224    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-data\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.812399 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.812374    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d8df69-ea03-48d6-827b-4307d06caad6-istiod-ca-cert\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.814921 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.814895    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-podinfo\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.815120 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.815101    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-envoy\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.871831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.871775    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-token\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.871985 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.871933    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6wv2\" (UniqueName: \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-kube-api-access-c6wv2\") pod \"e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") " pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:19.903130 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:19.902892    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:20.154463 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:20.154369    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:20.227858 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:20.225780    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:20.592124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:20.592087    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"]
Oct 30 19:58:20.598047 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:58:20.598017    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d8df69_ea03_48d6_827b_4307d06caad6.slice/crio-e73a111bdd17c5d779df69acaddad80140d67c3f32aeae0eb876737b7dd27032 WatchSource:0}: Error finding container e73a111bdd17c5d779df69acaddad80140d67c3f32aeae0eb876737b7dd27032: Status 404 returned error can't find the container with id e73a111bdd17c5d779df69acaddad80140d67c3f32aeae0eb876737b7dd27032
Oct 30 19:58:20.600733 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:20.600699    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:20.600856 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:20.600770    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:20.600856 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:20.600799    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:20.949204 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:20.949104    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" event={"ID":"e2d8df69-ea03-48d6-827b-4307d06caad6","Type":"ContainerStarted","Data":"b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879"}
Oct 30 19:58:20.949342 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:20.949203    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" event={"ID":"e2d8df69-ea03-48d6-827b-4307d06caad6","Type":"ContainerStarted","Data":"e73a111bdd17c5d779df69acaddad80140d67c3f32aeae0eb876737b7dd27032"}
Oct 30 19:58:21.068926 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:21.068869    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" podStartSLOduration=2.068853321 podStartE2EDuration="2.068853321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:58:21.06751398 +0000 UTC m=+1963.610321246" watchObservedRunningTime="2026-10-30 19:58:21.068853321 +0000 UTC m=+1963.611660585"
Oct 30 19:58:21.155488 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:21.155444    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:21.161450 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:21.161423    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:21.956443 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:21.956405    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:21.957542 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:21.957515    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:58:22.254645 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:22.254558    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:22.497087 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:22.497043    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:22.600464 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:22.600428    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"]
Oct 30 19:58:22.600744 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:22.600715    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy" containerID="cri-o://ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb" gracePeriod=30
Oct 30 19:58:22.669797 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:22.669764    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:23.164846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:23.164780    6015 patch_prober.go:29] interesting pod/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 19:58:23.165030 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:23.164878    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 19:58:23.609283 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:23.609246    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:24.214072 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.214039    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"]
Oct 30 19:58:24.219588 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.219563    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.273431 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.273394    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-socket\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.273573 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.273467    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-credential-socket\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.273639 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.273564    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-certs\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.273680 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.273651    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-istio-token\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.273754 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.273741    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-data\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.273841 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.273822    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59lxb\" (UniqueName: \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-kube-api-access-59lxb\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.273906 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.273876    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f94d13-901e-4522-8371-269003fe656f-istiod-ca-cert\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.273960 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.273928    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f94d13-901e-4522-8371-269003fe656f-istio-podinfo\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.274069 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.274047    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-envoy\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.276017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.275990    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-a299b8-openshift-default-dockercfg-rq6lh\""
Oct 30 19:58:24.324847 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.324800    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"]
Oct 30 19:58:24.333598 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.333558    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:24.375920 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.375878    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-envoy\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.376130 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376019    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-socket\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.376130 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376070    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-credential-socket\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.376130 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376108    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-certs\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.376311 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376150    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-istio-token\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.376311 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376257    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-data\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.376311 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376291    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59lxb\" (UniqueName: \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-kube-api-access-59lxb\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.376472 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376340    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f94d13-901e-4522-8371-269003fe656f-istiod-ca-cert\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.376472 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376376    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f94d13-901e-4522-8371-269003fe656f-istio-podinfo\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.376592 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376466    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-socket\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.376708 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376682    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-certs\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.376862 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376831    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-credential-socket\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.377129 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.376917    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-data\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.377844 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.377798    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f94d13-901e-4522-8371-269003fe656f-istiod-ca-cert\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.379401 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.379380    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-envoy\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.379792 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.379773    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f94d13-901e-4522-8371-269003fe656f-istio-podinfo\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.439831 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.439521    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-istio-token\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.440431 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.440399    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59lxb\" (UniqueName: \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-kube-api-access-59lxb\") pod \"e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") " pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.535221 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.535116    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:24.540017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.539983    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:24.952857 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.952819    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"]
Oct 30 19:58:24.953308 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.953022    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4" podUID="09f49230-4ef8-4ce8-88ad-4ca5e788f854" containerName="maas-api" containerID="cri-o://dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0" gracePeriod=30
Oct 30 19:58:24.987416 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:24.980915    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"]
Oct 30 19:58:25.059445 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.059402    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:25.059738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.059504    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:25.059738 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.059547    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:25.097749 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.097704    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:25.248835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.248792    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:58:25.298725 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.298685    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-maas-api-tls\") pod \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") "
Oct 30 19:58:25.298948 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.298755    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09f49230-4ef8-4ce8-88ad-4ca5e788f854-kube-api-access-swc97\" (UniqueName: \"kubernetes.io/projected/09f49230-4ef8-4ce8-88ad-4ca5e788f854-kube-api-access-swc97\") pod \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") "
Oct 30 19:58:25.298948 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.298797    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09f49230-4ef8-4ce8-88ad-4ca5e788f854-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09f49230-4ef8-4ce8-88ad-4ca5e788f854-openshift-service-ca\") pod \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") "
Oct 30 19:58:25.298948 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.298857    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-metrics-certs\" (UniqueName: \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-metrics-certs\") pod \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\" (UID: \"09f49230-4ef8-4ce8-88ad-4ca5e788f854\") "
Oct 30 19:58:25.302684 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.302640    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-maas-api-tls" pod "09f49230-4ef8-4ce8-88ad-4ca5e788f854" (UID: "09f49230-4ef8-4ce8-88ad-4ca5e788f854"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:58:25.305125 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.305091    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09f49230-4ef8-4ce8-88ad-4ca5e788f854-openshift-service-ca" pod "09f49230-4ef8-4ce8-88ad-4ca5e788f854" (UID: "09f49230-4ef8-4ce8-88ad-4ca5e788f854"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:58:25.307340 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.307269    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09f49230-4ef8-4ce8-88ad-4ca5e788f854-kube-api-access-swc97" pod "09f49230-4ef8-4ce8-88ad-4ca5e788f854" (UID: "09f49230-4ef8-4ce8-88ad-4ca5e788f854"). InnerVolumeSpecName "kube-api-access-swc97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:58:25.307830 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.307541    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-metrics-certs" pod "09f49230-4ef8-4ce8-88ad-4ca5e788f854" (UID: "09f49230-4ef8-4ce8-88ad-4ca5e788f854"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 19:58:25.403604 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.403567    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:25.403855 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.403831    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swc97\" (UniqueName: \"kubernetes.io/projected/09f49230-4ef8-4ce8-88ad-4ca5e788f854-kube-api-access-swc97\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:25.403991 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.403976    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09f49230-4ef8-4ce8-88ad-4ca5e788f854-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:25.404252 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.404233    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09f49230-4ef8-4ce8-88ad-4ca5e788f854-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:25.997889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.997556    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" event={"ID":"c8f94d13-901e-4522-8371-269003fe656f","Type":"ContainerStarted","Data":"e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55"}
Oct 30 19:58:25.997889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:25.997628    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" event={"ID":"c8f94d13-901e-4522-8371-269003fe656f","Type":"ContainerStarted","Data":"3848a66b771706af597928ad5da7e25d2810becb927666b825044524ca38d420"}
Oct 30 19:58:26.002740 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.000762    6015 generic.go:356] "Generic (PLEG): container finished" podID="09f49230-4ef8-4ce8-88ad-4ca5e788f854" containerID="dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0" exitCode=0
Oct 30 19:58:26.002740 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.000870    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4" event={"ID":"09f49230-4ef8-4ce8-88ad-4ca5e788f854","Type":"ContainerDied","Data":"dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0"}
Oct 30 19:58:26.002740 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.000917    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4" event={"ID":"09f49230-4ef8-4ce8-88ad-4ca5e788f854","Type":"ContainerDied","Data":"f3b0a68def0eac94481593b5ec2f68a1cec240f51524c18af3bddcda2011668d"}
Oct 30 19:58:26.002740 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.000944    6015 scope.go:122] "RemoveContainer" containerID="dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0"
Oct 30 19:58:26.002740 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.001117    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"
Oct 30 19:58:26.051625 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.051598    6015 scope.go:122] "RemoveContainer" containerID="dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0"
Oct 30 19:58:26.052111 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:58:26.052077    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0\": container with ID starting with dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0 not found: ID does not exist" containerID="dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0"
Oct 30 19:58:26.052210 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.052122    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0"} err="failed to get container status \"dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0\": rpc error: code = NotFound desc = could not find container \"dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0\": container with ID starting with dcf69e5b3fedd6df18ca5af8e0f8ec67f50067fdd3a91012977cf3eab76af2c0 not found: ID does not exist"
Oct 30 19:58:26.150087 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.150031    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" podStartSLOduration=2.150013123 podStartE2EDuration="2.150013123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:58:26.149646837 +0000 UTC m=+1968.692454102" watchObservedRunningTime="2026-10-30 19:58:26.150013123 +0000 UTC m=+1968.692820389"
Oct 30 19:58:26.257687 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.257603    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"]
Oct 30 19:58:26.262887 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.262855    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-69932e-b569b7486-xs7q4"]
Oct 30 19:58:26.536216 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.536117    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:26.542217 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:26.542188    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:27.009470 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.009438    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:27.010500 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.010481    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 19:58:27.018566 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.018537    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:27.220194 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.220157    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:27.379668 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.379630    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:27.538371 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.538333    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:27.589517 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.589478    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09f49230-4ef8-4ce8-88ad-4ca5e788f854" path="/var/lib/kubelet/pods/09f49230-4ef8-4ce8-88ad-4ca5e788f854/volumes"
Oct 30 19:58:27.786333 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.786268    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"]
Oct 30 19:58:27.787361 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.787319    6015 cpu_manager.go:414] "containerMap: removing container" podUID="09f49230-4ef8-4ce8-88ad-4ca5e788f854" containerName="maas-api"
Oct 30 19:58:27.787361 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.787346    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09f49230-4ef8-4ce8-88ad-4ca5e788f854" containerName="maas-api"
Oct 30 19:58:27.787561 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.787471    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="09f49230-4ef8-4ce8-88ad-4ca5e788f854" containerName="maas-api"
Oct 30 19:58:27.801618 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.793585    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 19:58:27.837450 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.837417    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbdad561-9d1f-423d-ac08-6b02e4f1748b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6\" (UID: \"bbdad561-9d1f-423d-ac08-6b02e4f1748b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 19:58:27.837675 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.837655    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkrzn\" (UniqueName: \"kubernetes.io/projected/bbdad561-9d1f-423d-ac08-6b02e4f1748b-kube-api-access-xkrzn\") pod \"payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6\" (UID: \"bbdad561-9d1f-423d-ac08-6b02e4f1748b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 19:58:27.844755 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.844731    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-d80c7d-dockercfg-zp6vq\""
Oct 30 19:58:27.850089 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.849890    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-d80c7d\""
Oct 30 19:58:27.854153 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.854128    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"]
Oct 30 19:58:27.945869 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.945744    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkrzn\" (UniqueName: \"kubernetes.io/projected/bbdad561-9d1f-423d-ac08-6b02e4f1748b-kube-api-access-xkrzn\") pod \"payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6\" (UID: \"bbdad561-9d1f-423d-ac08-6b02e4f1748b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 19:58:27.945869 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.945858    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbdad561-9d1f-423d-ac08-6b02e4f1748b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6\" (UID: \"bbdad561-9d1f-423d-ac08-6b02e4f1748b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 19:58:27.946974 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.946944    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbdad561-9d1f-423d-ac08-6b02e4f1748b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6\" (UID: \"bbdad561-9d1f-423d-ac08-6b02e4f1748b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 19:58:27.958897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.955106    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:58:27.958897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.956095    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"]
Oct 30 19:58:27.958897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.957004    6015 cpu_manager.go:414] "containerMap: removing container" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy"
Oct 30 19:58:27.958897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.957026    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy"
Oct 30 19:58:27.958897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.957212    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy"
Oct 30 19:58:27.958897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.957234    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy"
Oct 30 19:58:27.962879 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.962851    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 19:58:27.998268 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:27.998224    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"]
Oct 30 19:58:28.008993 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.008957    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkrzn\" (UniqueName: \"kubernetes.io/projected/bbdad561-9d1f-423d-ac08-6b02e4f1748b-kube-api-access-xkrzn\") pod \"payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6\" (UID: \"bbdad561-9d1f-423d-ac08-6b02e4f1748b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 19:58:28.021391 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.021359    6015 generic.go:356] "Generic (PLEG): container finished" podID="f757f773-8081-4637-ba77-fa0dfe16404d" containerID="ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb" exitCode=0
Oct 30 19:58:28.021921 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.021435    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"
Oct 30 19:58:28.021921 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.021544    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" event={"ID":"f757f773-8081-4637-ba77-fa0dfe16404d","Type":"ContainerDied","Data":"ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb"}
Oct 30 19:58:28.021921 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.021582    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz" event={"ID":"f757f773-8081-4637-ba77-fa0dfe16404d","Type":"ContainerDied","Data":"4760ccca58eb52e17681cee5d0bb89638362de8c4ce4356b00ff9a15c78d5384"}
Oct 30 19:58:28.021921 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.021602    6015 scope.go:122] "RemoveContainer" containerID="ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb"
Oct 30 19:58:28.032293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.032269    6015 scope.go:122] "RemoveContainer" containerID="79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3"
Oct 30 19:58:28.045298 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.044915    6015 scope.go:122] "RemoveContainer" containerID="ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb"
Oct 30 19:58:28.045728 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:58:28.045699    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb\": container with ID starting with ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb not found: ID does not exist" containerID="ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb"
Oct 30 19:58:28.045893 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.045748    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb"} err="failed to get container status \"ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb\": rpc error: code = NotFound desc = could not find container \"ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb\": container with ID starting with ed4f2f452945906f1e01832c6d5de0bbd16c7a8de3adfcb37356c90f4db073cb not found: ID does not exist"
Oct 30 19:58:28.045893 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.045769    6015 scope.go:122] "RemoveContainer" containerID="79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3"
Oct 30 19:58:28.046123 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:58:28.046101    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3\": container with ID starting with 79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3 not found: ID does not exist" containerID="79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3"
Oct 30 19:58:28.046180 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046129    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3"} err="failed to get container status \"79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3\": rpc error: code = NotFound desc = could not find container \"79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3\": container with ID starting with 79d3c0897dce4ee3786657c8d89e817fd4294f13c11afedda7c1a56c6991f2d3 not found: ID does not exist"
Oct 30 19:58:28.046417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046391    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-credential-socket\") pod \"f757f773-8081-4637-ba77-fa0dfe16404d\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") "
Oct 30 19:58:28.046514 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046500    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-socket\") pod \"f757f773-8081-4637-ba77-fa0dfe16404d\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") "
Oct 30 19:58:28.046567 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046543    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f757f773-8081-4637-ba77-fa0dfe16404d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f757f773-8081-4637-ba77-fa0dfe16404d-istio-podinfo\") pod \"f757f773-8081-4637-ba77-fa0dfe16404d\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") "
Oct 30 19:58:28.046620 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046588    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-envoy\") pod \"f757f773-8081-4637-ba77-fa0dfe16404d\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") "
Oct 30 19:58:28.046674 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046634    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-credential-socket" pod "f757f773-8081-4637-ba77-fa0dfe16404d" (UID: "f757f773-8081-4637-ba77-fa0dfe16404d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:58:28.046734 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046694    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-certs\") pod \"f757f773-8081-4637-ba77-fa0dfe16404d\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") "
Oct 30 19:58:28.046846 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046786    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-socket" pod "f757f773-8081-4637-ba77-fa0dfe16404d" (UID: "f757f773-8081-4637-ba77-fa0dfe16404d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:58:28.046914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046871    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-data\") pod \"f757f773-8081-4637-ba77-fa0dfe16404d\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") "
Oct 30 19:58:28.046975 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046914    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-istio-token\" (UniqueName: \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-istio-token\") pod \"f757f773-8081-4637-ba77-fa0dfe16404d\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") "
Oct 30 19:58:28.046975 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046952    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-certs" pod "f757f773-8081-4637-ba77-fa0dfe16404d" (UID: "f757f773-8081-4637-ba77-fa0dfe16404d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:58:28.047056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.046975    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-kube-api-access-czvft\" (UniqueName: \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-kube-api-access-czvft\") pod \"f757f773-8081-4637-ba77-fa0dfe16404d\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") "
Oct 30 19:58:28.047121 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.047100    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-data" pod "f757f773-8081-4637-ba77-fa0dfe16404d" (UID: "f757f773-8081-4637-ba77-fa0dfe16404d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:58:28.047216 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.047195    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f757f773-8081-4637-ba77-fa0dfe16404d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f757f773-8081-4637-ba77-fa0dfe16404d-istiod-ca-cert\") pod \"f757f773-8081-4637-ba77-fa0dfe16404d\" (UID: \"f757f773-8081-4637-ba77-fa0dfe16404d\") "
Oct 30 19:58:28.047774 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.047665    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f757f773-8081-4637-ba77-fa0dfe16404d-istiod-ca-cert" pod "f757f773-8081-4637-ba77-fa0dfe16404d" (UID: "f757f773-8081-4637-ba77-fa0dfe16404d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 19:58:28.047914 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.047770    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aebb37f4-5c2f-4be5-844f-8d93852ebad6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs\" (UID: \"aebb37f4-5c2f-4be5-844f-8d93852ebad6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 19:58:28.048010 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.047984    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lj29\" (UniqueName: \"kubernetes.io/projected/aebb37f4-5c2f-4be5-844f-8d93852ebad6-kube-api-access-9lj29\") pod \"payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs\" (UID: \"aebb37f4-5c2f-4be5-844f-8d93852ebad6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 19:58:28.048293 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.048273    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:28.048421 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.048399    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:28.048528 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.048426    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f757f773-8081-4637-ba77-fa0dfe16404d-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:28.048528 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.048442    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:28.048528 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.048458    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:28.049189 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.049161    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-istio-token" pod "f757f773-8081-4637-ba77-fa0dfe16404d" (UID: "f757f773-8081-4637-ba77-fa0dfe16404d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:58:28.049271 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.049215    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f757f773-8081-4637-ba77-fa0dfe16404d-istio-podinfo" pod "f757f773-8081-4637-ba77-fa0dfe16404d" (UID: "f757f773-8081-4637-ba77-fa0dfe16404d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 19:58:28.049271 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.049257    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-envoy" pod "f757f773-8081-4637-ba77-fa0dfe16404d" (UID: "f757f773-8081-4637-ba77-fa0dfe16404d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 19:58:28.049407 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.049389    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-kube-api-access-czvft" pod "f757f773-8081-4637-ba77-fa0dfe16404d" (UID: "f757f773-8081-4637-ba77-fa0dfe16404d"). InnerVolumeSpecName "kube-api-access-czvft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 19:58:28.113292 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.113250    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:28.122886 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.122855    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 19:58:28.150056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.149987    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aebb37f4-5c2f-4be5-844f-8d93852ebad6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs\" (UID: \"aebb37f4-5c2f-4be5-844f-8d93852ebad6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 19:58:28.150204 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.150095    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lj29\" (UniqueName: \"kubernetes.io/projected/aebb37f4-5c2f-4be5-844f-8d93852ebad6-kube-api-access-9lj29\") pod \"payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs\" (UID: \"aebb37f4-5c2f-4be5-844f-8d93852ebad6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 19:58:28.150398 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.150377    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czvft\" (UniqueName: \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-kube-api-access-czvft\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:28.150474 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.150404    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f757f773-8081-4637-ba77-fa0dfe16404d-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:28.150474 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.150418    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f757f773-8081-4637-ba77-fa0dfe16404d-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:28.150474 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.150431    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f757f773-8081-4637-ba77-fa0dfe16404d-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 19:58:28.150745 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.150722    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aebb37f4-5c2f-4be5-844f-8d93852ebad6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs\" (UID: \"aebb37f4-5c2f-4be5-844f-8d93852ebad6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 19:58:28.211255 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.211108    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lj29\" (UniqueName: \"kubernetes.io/projected/aebb37f4-5c2f-4be5-844f-8d93852ebad6-kube-api-access-9lj29\") pod \"payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs\" (UID: \"aebb37f4-5c2f-4be5-844f-8d93852ebad6\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 19:58:28.229861 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:58:28.229702    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:58:28.282512 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.282468    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 19:58:28.440075 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.440009    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"]
Oct 30 19:58:28.443467 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.443439    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4b1a4c-openshift-default-758c6df5d5-fgkpz"]
Oct 30 19:58:28.509845 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.509734    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"]
Oct 30 19:58:28.514486 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:58:28.514454    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbdad561_9d1f_423d_ac08_6b02e4f1748b.slice/crio-0160a271c45ccf1cd28fb750164e9e54f7f9e8786bbc9953d2228423e895fa95 WatchSource:0}: Error finding container 0160a271c45ccf1cd28fb750164e9e54f7f9e8786bbc9953d2228423e895fa95: Status 404 returned error can't find the container with id 0160a271c45ccf1cd28fb750164e9e54f7f9e8786bbc9953d2228423e895fa95
Oct 30 19:58:28.674468 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:28.674433    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"]
Oct 30 19:58:28.682055 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:58:28.682020    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaebb37f4_5c2f_4be5_844f_8d93852ebad6.slice/crio-e2a8d2647dd6ca5b22e02e70f111c28c4ab440579760b661a2a9cbd7ad27610d WatchSource:0}: Error finding container e2a8d2647dd6ca5b22e02e70f111c28c4ab440579760b661a2a9cbd7ad27610d: Status 404 returned error can't find the container with id e2a8d2647dd6ca5b22e02e70f111c28c4ab440579760b661a2a9cbd7ad27610d
Oct 30 19:58:29.031741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:29.031639    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs" event={"ID":"aebb37f4-5c2f-4be5-844f-8d93852ebad6","Type":"ContainerStarted","Data":"1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4"}
Oct 30 19:58:29.031741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:29.031703    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs" event={"ID":"aebb37f4-5c2f-4be5-844f-8d93852ebad6","Type":"ContainerStarted","Data":"e2a8d2647dd6ca5b22e02e70f111c28c4ab440579760b661a2a9cbd7ad27610d"}
Oct 30 19:58:29.032253 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:29.031850    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 19:58:29.034403 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:29.034360    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6" event={"ID":"bbdad561-9d1f-423d-ac08-6b02e4f1748b","Type":"ContainerStarted","Data":"fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef"}
Oct 30 19:58:29.034524 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:29.034419    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6" event={"ID":"bbdad561-9d1f-423d-ac08-6b02e4f1748b","Type":"ContainerStarted","Data":"0160a271c45ccf1cd28fb750164e9e54f7f9e8786bbc9953d2228423e895fa95"}
Oct 30 19:58:29.034571 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:29.034548    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 19:58:29.146904 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:29.146842    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs" podStartSLOduration=2.146787575 podStartE2EDuration="2.146787575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:58:29.144089593 +0000 UTC m=+1971.686896859" watchObservedRunningTime="2026-10-30 19:58:29.146787575 +0000 UTC m=+1971.689594861"
Oct 30 19:58:29.255189 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:29.255124    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6" podStartSLOduration=2.255109053 podStartE2EDuration="2.255109053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:58:29.253782962 +0000 UTC m=+1971.796590229" watchObservedRunningTime="2026-10-30 19:58:29.255109053 +0000 UTC m=+1971.797916356"
Oct 30 19:58:29.591447 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:29.591407    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" path="/var/lib/kubelet/pods/f757f773-8081-4637-ba77-fa0dfe16404d/volumes"
Oct 30 19:58:30.102630 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:30.102595    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:30.314383 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:30.314346    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:32.701295 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:32.701259    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:34.889406 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:34.889376    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:35.109113 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.109074    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:35.318262 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.318216    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"]
Oct 30 19:58:35.318950 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.318928    6015 cpu_manager.go:414] "containerMap: removing container" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy"
Oct 30 19:58:35.318950 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.318949    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f757f773-8081-4637-ba77-fa0dfe16404d" containerName="istio-proxy"
Oct 30 19:58:35.323642 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.323617    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 19:58:35.420117 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.420077    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-a299b8\""
Oct 30 19:58:35.420338 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.420244    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-a299b8-dockercfg-rbcg4\""
Oct 30 19:58:35.424347 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.424314    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"]
Oct 30 19:58:35.448898 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.448858    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:35.465640 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.465385    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjhqj\" (UniqueName: \"kubernetes.io/projected/8b814d23-7343-4d5e-80e0-d024bf78677d-kube-api-access-wjhqj\") pod \"payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2\" (UID: \"8b814d23-7343-4d5e-80e0-d024bf78677d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 19:58:35.465640 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.465518    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b814d23-7343-4d5e-80e0-d024bf78677d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2\" (UID: \"8b814d23-7343-4d5e-80e0-d024bf78677d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 19:58:35.477388 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.477242    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"]
Oct 30 19:58:35.511195 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.511164    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 19:58:35.533837 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.529875    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"]
Oct 30 19:58:35.576892 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.573122    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjhqj\" (UniqueName: \"kubernetes.io/projected/8b814d23-7343-4d5e-80e0-d024bf78677d-kube-api-access-wjhqj\") pod \"payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2\" (UID: \"8b814d23-7343-4d5e-80e0-d024bf78677d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 19:58:35.576892 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.573278    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b814d23-7343-4d5e-80e0-d024bf78677d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2\" (UID: \"8b814d23-7343-4d5e-80e0-d024bf78677d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 19:58:35.576892 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.573302    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl52x\" (UniqueName: \"kubernetes.io/projected/355f9df6-1f21-4167-88a2-624cfd3812b1-kube-api-access-bl52x\") pod \"payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp\" (UID: \"355f9df6-1f21-4167-88a2-624cfd3812b1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 19:58:35.576892 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.573382    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/355f9df6-1f21-4167-88a2-624cfd3812b1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp\" (UID: \"355f9df6-1f21-4167-88a2-624cfd3812b1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 19:58:35.576892 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.574428    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b814d23-7343-4d5e-80e0-d024bf78677d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2\" (UID: \"8b814d23-7343-4d5e-80e0-d024bf78677d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 19:58:35.636880 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.636843    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjhqj\" (UniqueName: \"kubernetes.io/projected/8b814d23-7343-4d5e-80e0-d024bf78677d-kube-api-access-wjhqj\") pod \"payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2\" (UID: \"8b814d23-7343-4d5e-80e0-d024bf78677d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 19:58:35.639061 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.639034    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 19:58:35.676835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.674446    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl52x\" (UniqueName: \"kubernetes.io/projected/355f9df6-1f21-4167-88a2-624cfd3812b1-kube-api-access-bl52x\") pod \"payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp\" (UID: \"355f9df6-1f21-4167-88a2-624cfd3812b1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 19:58:35.676835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.674522    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/355f9df6-1f21-4167-88a2-624cfd3812b1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp\" (UID: \"355f9df6-1f21-4167-88a2-624cfd3812b1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 19:58:35.676835 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.675254    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/355f9df6-1f21-4167-88a2-624cfd3812b1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp\" (UID: \"355f9df6-1f21-4167-88a2-624cfd3812b1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 19:58:35.679295 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.679244    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:35.769928 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.766090    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl52x\" (UniqueName: \"kubernetes.io/projected/355f9df6-1f21-4167-88a2-624cfd3812b1-kube-api-access-bl52x\") pod \"payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp\" (UID: \"355f9df6-1f21-4167-88a2-624cfd3812b1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 19:58:35.867780 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:35.867680    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 19:58:36.034116 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:36.034080    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"]
Oct 30 19:58:36.040340 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:58:36.040315    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b814d23_7343_4d5e_80e0_d024bf78677d.slice/crio-a5bffc73ba4cd59590798467a2a5381f5b94cbf4598afce54ebef7678206a9db WatchSource:0}: Error finding container a5bffc73ba4cd59590798467a2a5381f5b94cbf4598afce54ebef7678206a9db: Status 404 returned error can't find the container with id a5bffc73ba4cd59590798467a2a5381f5b94cbf4598afce54ebef7678206a9db
Oct 30 19:58:36.079879 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:36.079841    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2" event={"ID":"8b814d23-7343-4d5e-80e0-d024bf78677d","Type":"ContainerStarted","Data":"a5bffc73ba4cd59590798467a2a5381f5b94cbf4598afce54ebef7678206a9db"}
Oct 30 19:58:36.251652 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:36.251559    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"]
Oct 30 19:58:36.256779 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:58:36.256735    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355f9df6_1f21_4167_88a2_624cfd3812b1.slice/crio-b3cebb27c45ea720b8855677c57b8ef027d3d43e0373f210e2473b238290fd72 WatchSource:0}: Error finding container b3cebb27c45ea720b8855677c57b8ef027d3d43e0373f210e2473b238290fd72: Status 404 returned error can't find the container with id b3cebb27c45ea720b8855677c57b8ef027d3d43e0373f210e2473b238290fd72
Oct 30 19:58:37.088550 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:37.088513    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp" event={"ID":"355f9df6-1f21-4167-88a2-624cfd3812b1","Type":"ContainerStarted","Data":"5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6"}
Oct 30 19:58:37.089091 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:37.088572    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp" event={"ID":"355f9df6-1f21-4167-88a2-624cfd3812b1","Type":"ContainerStarted","Data":"b3cebb27c45ea720b8855677c57b8ef027d3d43e0373f210e2473b238290fd72"}
Oct 30 19:58:37.089091 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:37.088620    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 19:58:37.090402 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:37.090379    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2" event={"ID":"8b814d23-7343-4d5e-80e0-d024bf78677d","Type":"ContainerStarted","Data":"d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143"}
Oct 30 19:58:37.090547 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:37.090487    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 19:58:37.320264 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:37.320196    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp" podStartSLOduration=2.320170454 podStartE2EDuration="2.320170454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:58:37.204389636 +0000 UTC m=+1979.747196905" watchObservedRunningTime="2026-10-30 19:58:37.320170454 +0000 UTC m=+1979.862977727"
Oct 30 19:58:38.086921 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:38.086880    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:39.935989 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:39.935935    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2" podStartSLOduration=4.9359158910000005 podStartE2EDuration="4.935915891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:58:37.321102838 +0000 UTC m=+1979.863910104" watchObservedRunningTime="2026-10-30 19:58:39.935915891 +0000 UTC m=+1982.478723159"
Oct 30 19:58:39.937818 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:39.937787    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"]
Oct 30 19:58:39.943353 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:39.943330    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:39.995052 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:39.995007    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"]
Oct 30 19:58:40.011473 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.011434    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.041799 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.041757    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.042020 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.041840    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdsl4\" (UniqueName: \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-kube-api-access-vdsl4\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.042020 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.041943    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.042130 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.042042    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.042130 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.042105    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.042243 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.042157    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"]
Oct 30 19:58:40.042243 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.042176    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.042325 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.042308    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.042359 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.042329    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.042443 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.042430    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.044632 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.044609    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 19:58:40.044782 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.044679    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 19:58:40.087469 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.087407    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"]
Oct 30 19:58:40.143741 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.143697    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.143933 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.143746    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.143933 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.143893    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.144113 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144089    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.144181 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144131    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.144239 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144189    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.144239 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144216    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.144352 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144330    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.144398 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144369    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.144433 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144417    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.144468 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144455    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm6qd\" (UniqueName: \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-kube-api-access-rm6qd\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.144516 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144498    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.144553 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144501    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.144601 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144586    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.144635 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144616    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.144669 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144646    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdsl4\" (UniqueName: \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-kube-api-access-vdsl4\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.144711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144693    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.144753 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144732    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.144879 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144861    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.144945 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144906    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.144945 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.144934    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.145033 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.145018    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.145288 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.145267    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.147172 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.147148    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.147417 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.147396    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.203525 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.203448    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.203704 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.203555    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdsl4\" (UniqueName: \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-kube-api-access-vdsl4\") pod \"maas-default-gateway-openshift-default-694db55c87-zqnbt\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.246725 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.246683    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.246934 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.246744    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.246934 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.246778    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.246934 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.246798    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.246934 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.246837    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.246934 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.246858    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm6qd\" (UniqueName: \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-kube-api-access-rm6qd\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.246934 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.246911    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.247269 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.246970    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.247269 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.247042    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.247269 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.247231    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.247542 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.247511    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.247629 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.247600    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.247692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.247632    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.247692 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.247670    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.250056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.250027    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.250318 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.250298    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.257430 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.257408    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:40.308500 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.308428    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm6qd\" (UniqueName: \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-kube-api-access-rm6qd\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.308686 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.308615    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-8shs8\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.327693 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.327561    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:40.710513 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.710468    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"]
Oct 30 19:58:40.717174 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:58:40.717141    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1390fa61_d871_4ad0_ab4b_0b581a7cb08f.slice/crio-1e9f212ea385c436aa4d8129f791b49f202a27d6ed30c13d5ceb1f702f0851a7 WatchSource:0}: Error finding container 1e9f212ea385c436aa4d8129f791b49f202a27d6ed30c13d5ceb1f702f0851a7: Status 404 returned error can't find the container with id 1e9f212ea385c436aa4d8129f791b49f202a27d6ed30c13d5ceb1f702f0851a7
Oct 30 19:58:40.724047 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.724009    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:40.724157 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.724104    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:40.724157 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.724144    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:40.763897 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.763863    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"]
Oct 30 19:58:40.770285 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:58:40.770248    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e74325_ee0f_43be_b4ef_c7ddf3778d43.slice/crio-71571ffac554e4d8bc2f1df7733b1fed44d832444c89cb2d1809cb2028eec898 WatchSource:0}: Error finding container 71571ffac554e4d8bc2f1df7733b1fed44d832444c89cb2d1809cb2028eec898: Status 404 returned error can't find the container with id 71571ffac554e4d8bc2f1df7733b1fed44d832444c89cb2d1809cb2028eec898
Oct 30 19:58:40.773677 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.773648    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:40.773755 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.773719    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:40.773755 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:40.773750    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:58:41.132184 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.131427    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" event={"ID":"1390fa61-d871-4ad0-ab4b-0b581a7cb08f","Type":"ContainerStarted","Data":"f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd"}
Oct 30 19:58:41.132658 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.132236    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" event={"ID":"1390fa61-d871-4ad0-ab4b-0b581a7cb08f","Type":"ContainerStarted","Data":"1e9f212ea385c436aa4d8129f791b49f202a27d6ed30c13d5ceb1f702f0851a7"}
Oct 30 19:58:41.133837 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.133793    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" event={"ID":"33e74325-ee0f-43be-b4ef-c7ddf3778d43","Type":"ContainerStarted","Data":"4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3"}
Oct 30 19:58:41.133980 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.133861    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" event={"ID":"33e74325-ee0f-43be-b4ef-c7ddf3778d43","Type":"ContainerStarted","Data":"71571ffac554e4d8bc2f1df7733b1fed44d832444c89cb2d1809cb2028eec898"}
Oct 30 19:58:41.249104 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.249047    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" podStartSLOduration=2.249030449 podStartE2EDuration="2.249030449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:58:41.24744859 +0000 UTC m=+1983.790255856" watchObservedRunningTime="2026-10-30 19:58:41.249030449 +0000 UTC m=+1983.791837713"
Oct 30 19:58:41.258592 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.258426    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:41.260497 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.260469    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zqnbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 19:58:41.260631 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.260516    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 19:58:41.328057 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.328002    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:41.329880 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.329849    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-8shs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 19:58:41.330029 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.329902    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 19:58:41.365832 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:41.364990    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" podStartSLOduration=2.364971284 podStartE2EDuration="2.364971284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:58:41.363236352 +0000 UTC m=+1983.906043668" watchObservedRunningTime="2026-10-30 19:58:41.364971284 +0000 UTC m=+1983.907778550"
Oct 30 19:58:42.257874 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:42.257833    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zqnbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 19:58:42.258287 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:42.257893    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 19:58:42.328503 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:42.328458    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-8shs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 19:58:42.328694 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:42.328517    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 19:58:43.258297 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:43.258255    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zqnbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 19:58:43.258711 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:43.258310    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 19:58:43.328540 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:43.328507    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-8shs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 19:58:43.328693 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:43.328558    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 19:58:43.627195 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:43.627151    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:44.258643 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:44.258600    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zqnbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 19:58:44.259079 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:44.258665    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 19:58:44.329068 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:44.329027    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-8shs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 19:58:44.329257 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:44.329085    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 19:58:45.258631 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:45.258592    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zqnbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 19:58:45.258843 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:45.258649    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 19:58:45.328886 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:45.328848    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-8shs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 19:58:45.329060 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:45.328899    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 19:58:46.258603 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:46.258514    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zqnbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 19:58:46.258603 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:46.258567    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 19:58:46.329011 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:46.328969    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-8shs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 19:58:46.329412 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:46.329036    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 19:58:47.257928 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:47.257882    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zqnbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 19:58:47.258099 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:47.257974    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 19:58:47.328007 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:47.327969    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-8shs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 19:58:47.328221 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:47.328027    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 19:58:48.101128 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:48.101090    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 19:58:48.101559 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:48.101176    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 19:58:48.258389 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:48.258353    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-zqnbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Oct 30 19:58:48.258572 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:48.258419    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Oct 30 19:58:48.328889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:48.328793    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-8shs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 19:58:48.329056 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:48.328909    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 19:58:48.458934 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:48.458836    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:48.659796 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:48.659753    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:49.352476 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:49.352440    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:49.716723 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:49.716639    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:49.718243 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:49.718184    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:49.719321 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:49.719297    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 19:58:49.741876 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:49.741846    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:49.742756 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:49.742729    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:49.743889 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:49.743871    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 19:58:50.060322 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:50.060273    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:54.690069 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:54.690020    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:58:58.220573 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:58:58.220537    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:58:59.451012 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:58:59.450978    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:01.239744 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:01.239708    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:01.449580 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:01.449544    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:01.608825 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:01.608768    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:02.243274 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:02.243236    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:07.032188 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:07.032151    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:08.807287 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:08.807250    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:09.008955 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:09.008919    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:09.227986 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:09.227885    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:10.469413 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:10.469366    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:11.508302 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:11.508262    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:11.732041 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:11.732001    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:12.351620 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:12.351581    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:12.511235 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:12.511200    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:12.680357 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:12.680239    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:16.157762 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:16.157720    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:16.366090 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:16.366046    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:16.535580 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:16.535490    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:17.919855 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:17.919793    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:18.139540 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:18.139502    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:18.290046 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:18.289954    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:23.248270 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:23.248228    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:23.410691 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:23.410652    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:24.046579 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:24.046544    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:24.247705 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:24.247663    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:26.865023 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:26.864982    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:27.063193 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.063154    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:27.280781 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.280676    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"]
Oct 30 19:59:27.286379 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.286351    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 19:59:27.335944 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.335899    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-ffe14b\""
Oct 30 19:59:27.343185 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.343142    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"]
Oct 30 19:59:27.434204 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.434169    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-ffe14b-dockercfg-fjrlr\""
Oct 30 19:59:27.435112 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.434964    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7e7ba59-738b-4209-89b9-f2f9710ace9c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w\" (UID: \"b7e7ba59-738b-4209-89b9-f2f9710ace9c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 19:59:27.435706 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.435680    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6fhq\" (UniqueName: \"kubernetes.io/projected/b7e7ba59-738b-4209-89b9-f2f9710ace9c-kube-api-access-j6fhq\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w\" (UID: \"b7e7ba59-738b-4209-89b9-f2f9710ace9c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 19:59:27.540318 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.540231    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7e7ba59-738b-4209-89b9-f2f9710ace9c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w\" (UID: \"b7e7ba59-738b-4209-89b9-f2f9710ace9c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 19:59:27.540318 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.540273    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6fhq\" (UniqueName: \"kubernetes.io/projected/b7e7ba59-738b-4209-89b9-f2f9710ace9c-kube-api-access-j6fhq\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w\" (UID: \"b7e7ba59-738b-4209-89b9-f2f9710ace9c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 19:59:27.541181 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.541155    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7e7ba59-738b-4209-89b9-f2f9710ace9c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w\" (UID: \"b7e7ba59-738b-4209-89b9-f2f9710ace9c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 19:59:27.599497 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.599467    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6fhq\" (UniqueName: \"kubernetes.io/projected/b7e7ba59-738b-4209-89b9-f2f9710ace9c-kube-api-access-j6fhq\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w\" (UID: \"b7e7ba59-738b-4209-89b9-f2f9710ace9c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 19:59:27.604419 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.604384    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 19:59:27.982346 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:27.982304    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"]
Oct 30 19:59:27.989075 ip-10-0-130-34 kubenswrapper[6015]: W1030 19:59:27.989042    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e7ba59_738b_4209_89b9_f2f9710ace9c.slice/crio-650a11186ac210973f1789a459f115ae812ed2d921bd713b81edd2e93edb0bc9 WatchSource:0}: Error finding container 650a11186ac210973f1789a459f115ae812ed2d921bd713b81edd2e93edb0bc9: Status 404 returned error can't find the container with id 650a11186ac210973f1789a459f115ae812ed2d921bd713b81edd2e93edb0bc9
Oct 30 19:59:28.217445 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:59:28.217407    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 19:59:28.497086 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:28.497047    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w" event={"ID":"b7e7ba59-738b-4209-89b9-f2f9710ace9c","Type":"ContainerStarted","Data":"84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695"}
Oct 30 19:59:28.497291 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:28.497120    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 19:59:28.497291 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:28.497138    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w" event={"ID":"b7e7ba59-738b-4209-89b9-f2f9710ace9c","Type":"ContainerStarted","Data":"650a11186ac210973f1789a459f115ae812ed2d921bd713b81edd2e93edb0bc9"}
Oct 30 19:59:28.501102 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:28.501070    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:28.609166 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:28.609107    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w" podStartSLOduration=1.609092346 podStartE2EDuration="1.609092346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:59:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:59:28.606552346 +0000 UTC m=+2031.149359611" watchObservedRunningTime="2026-10-30 19:59:28.609092346 +0000 UTC m=+2031.151899610"
Oct 30 19:59:33.534000 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:33.533960    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:37.956078 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:37.956034    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:37.999013 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:37.998964    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 19:59:37.999209 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:37.999042    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:59:38.247953 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:38.247341    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:38.407040 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:38.407004    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:39.511703 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:39.511670    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 19:59:39.570452 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:39.570418    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:39.589078 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:39.589042    6015 generic.go:356] "Generic (PLEG): container finished" podID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerID="b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879" exitCode=0
Oct 30 19:59:39.591667 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:39.591632    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" event={"ID":"e2d8df69-ea03-48d6-827b-4307d06caad6","Type":"ContainerDied","Data":"b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879"}
Oct 30 19:59:39.592141 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:39.592123    6015 scope.go:122] "RemoveContainer" containerID="b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879"
Oct 30 19:59:39.594049 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:39.594015    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:59:39.594140 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:39.594110    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:59:39.594185 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:39.594154    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 19:59:39.795593 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:39.795493    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:39.953296 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:39.953249    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:40.520046 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:40.520002    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:40.601661 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:40.601622    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" event={"ID":"e2d8df69-ea03-48d6-827b-4307d06caad6","Type":"ContainerStarted","Data":"c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02"}
Oct 30 19:59:41.154479 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:41.154443    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:59:41.154747 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:41.154727    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 19:59:41.154797 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:41.154770    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 19:59:42.155195 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:42.155158    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 19:59:42.155603 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:42.155213    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 19:59:43.155006 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:43.154965    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 19:59:43.155209 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:43.155024    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 19:59:44.155263 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:44.155230    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 19:59:44.155670 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:44.155281    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 19:59:45.155526 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:45.155486    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 19:59:45.155960 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:45.155542    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 19:59:45.180566 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:45.180530    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:45.583446 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:45.583406    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:46.159040 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:46.159008    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:59:46.159500 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:46.159470    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:59:46.160124 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:46.160104    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 19:59:50.424830 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:50.424775    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:50.714681 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:50.714576    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:56.111102 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:56.111060    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 19:59:58.051017 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:58.050968    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 19:59:58.051504 ip-10-0-130-34 kubenswrapper[6015]: I1030 19:59:58.051046    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 19:59:58.221117 ip-10-0-130-34 kubenswrapper[6015]: E1030 19:59:58.221080    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:00:00.201988 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.201943    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"]
Oct 30 20:00:00.208118 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.208085    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"]
Oct 30 20:00:00.210656 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.210626    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"
Oct 30 20:00:00.212672 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.212641    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"
Oct 30 20:00:00.293379 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.293337    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"]
Oct 30 20:00:00.295154 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.294327    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z9tz\" (UniqueName: \"kubernetes.io/projected/d836c127-db66-4cc7-aff0-840a8cf272f0-kube-api-access-6z9tz\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89\" (UID: \"d836c127-db66-4cc7-aff0-840a8cf272f0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"
Oct 30 20:00:00.295498 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.295481    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a52019d-6b02-43bc-a936-cc4ce3027259-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc\" (UID: \"8a52019d-6b02-43bc-a936-cc4ce3027259\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"
Oct 30 20:00:00.295674 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.295657    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btzw8\" (UniqueName: \"kubernetes.io/projected/8a52019d-6b02-43bc-a936-cc4ce3027259-kube-api-access-btzw8\") pod \"maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc\" (UID: \"8a52019d-6b02-43bc-a936-cc4ce3027259\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"
Oct 30 20:00:00.295870 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.295854    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d836c127-db66-4cc7-aff0-840a8cf272f0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89\" (UID: \"d836c127-db66-4cc7-aff0-840a8cf272f0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"
Oct 30 20:00:00.314903 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.314863    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"]
Oct 30 20:00:00.335511 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.335474    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kmwqm\""
Oct 30 20:00:00.403318 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.397885    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9tz\" (UniqueName: \"kubernetes.io/projected/d836c127-db66-4cc7-aff0-840a8cf272f0-kube-api-access-6z9tz\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89\" (UID: \"d836c127-db66-4cc7-aff0-840a8cf272f0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"
Oct 30 20:00:00.403318 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.398073    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a52019d-6b02-43bc-a936-cc4ce3027259-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc\" (UID: \"8a52019d-6b02-43bc-a936-cc4ce3027259\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"
Oct 30 20:00:00.403318 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.398126    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzw8\" (UniqueName: \"kubernetes.io/projected/8a52019d-6b02-43bc-a936-cc4ce3027259-kube-api-access-btzw8\") pod \"maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc\" (UID: \"8a52019d-6b02-43bc-a936-cc4ce3027259\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"
Oct 30 20:00:00.403318 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.398195    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d836c127-db66-4cc7-aff0-840a8cf272f0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89\" (UID: \"d836c127-db66-4cc7-aff0-840a8cf272f0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"
Oct 30 20:00:00.403318 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.399146    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d836c127-db66-4cc7-aff0-840a8cf272f0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89\" (UID: \"d836c127-db66-4cc7-aff0-840a8cf272f0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"
Oct 30 20:00:00.445579 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.440779    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a52019d-6b02-43bc-a936-cc4ce3027259-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc\" (UID: \"8a52019d-6b02-43bc-a936-cc4ce3027259\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"
Oct 30 20:00:00.462093 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.461983    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z9tz\" (UniqueName: \"kubernetes.io/projected/d836c127-db66-4cc7-aff0-840a8cf272f0-kube-api-access-6z9tz\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89\" (UID: \"d836c127-db66-4cc7-aff0-840a8cf272f0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"
Oct 30 20:00:00.472125 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.472081    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btzw8\" (UniqueName: \"kubernetes.io/projected/8a52019d-6b02-43bc-a936-cc4ce3027259-kube-api-access-btzw8\") pod \"maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc\" (UID: \"8a52019d-6b02-43bc-a936-cc4ce3027259\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"
Oct 30 20:00:00.529879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.529840    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"
Oct 30 20:00:00.536718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.536686    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"
Oct 30 20:00:00.943759 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.943714    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"]
Oct 30 20:00:00.957461 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:00:00.957430    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd836c127_db66_4cc7_aff0_840a8cf272f0.slice/crio-0ff51f136a9f0dfdd1e32b9853bf654df338e80faa2bbc4d5355e1275da455e1 WatchSource:0}: Error finding container 0ff51f136a9f0dfdd1e32b9853bf654df338e80faa2bbc4d5355e1275da455e1: Status 404 returned error can't find the container with id 0ff51f136a9f0dfdd1e32b9853bf654df338e80faa2bbc4d5355e1275da455e1
Oct 30 20:00:00.959863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:00.959841    6015 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:00:01.009187 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.006778    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"]
Oct 30 20:00:01.024973 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.024893    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:01.244469 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.244359    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:01.401944 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.401908    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:01.792125 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.792081    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" event={"ID":"d836c127-db66-4cc7-aff0-840a8cf272f0","Type":"ContainerStarted","Data":"0ff51f136a9f0dfdd1e32b9853bf654df338e80faa2bbc4d5355e1275da455e1"}
Oct 30 20:00:01.793428 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.793399    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc" event={"ID":"8a52019d-6b02-43bc-a936-cc4ce3027259","Type":"ContainerStarted","Data":"9be62cc00a1f91a5f67fb0fd4488e82273fa7725b769794de8158d57eeb3aa22"}
Oct 30 20:00:01.794987 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.794964    6015 generic.go:356] "Generic (PLEG): container finished" podID="c8f94d13-901e-4522-8371-269003fe656f" containerID="e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55" exitCode=0
Oct 30 20:00:01.795106 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.794990    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" event={"ID":"c8f94d13-901e-4522-8371-269003fe656f","Type":"ContainerDied","Data":"e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55"}
Oct 30 20:00:01.795396 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.795383    6015 scope.go:122] "RemoveContainer" containerID="e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55"
Oct 30 20:00:01.796918 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.796891    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:00:01.796984 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.796963    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:00:01.797020 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:01.796996    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:00:02.806581 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:02.806546    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" event={"ID":"c8f94d13-901e-4522-8371-269003fe656f","Type":"ContainerStarted","Data":"9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba"}
Oct 30 20:00:03.535911 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:03.535871    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 20:00:03.536434 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:03.536409    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:00:03.536502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:03.536459    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Oct 30 20:00:04.536324 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:04.536289    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:00:04.536762 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:04.536700    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Oct 30 20:00:05.536179 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:05.536085    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:00:05.536179 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:05.536143    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Oct 30 20:00:06.497991 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:06.497944    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:06.537299 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:06.537239    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:00:06.537797 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:06.537358    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Oct 30 20:00:06.703509 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:06.703431    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:07.455729 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:07.455668    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:07.536451 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:07.536413    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Oct 30 20:00:07.536646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:07.536475    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Oct 30 20:00:08.430456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:08.430425    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:08.542223 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:08.542145    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 20:00:08.542675 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:08.542661    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 20:00:08.543336 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:08.543315    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 20:00:08.659891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:08.659856    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:08.861149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:08.861113    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc" event={"ID":"8a52019d-6b02-43bc-a936-cc4ce3027259","Type":"ContainerStarted","Data":"82ef3e24ba3a37c12ef687b5934cc58a053c301aafa8a5fa854db36335e8d4c7"}
Oct 30 20:00:08.862992 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:08.862963    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" event={"ID":"d836c127-db66-4cc7-aff0-840a8cf272f0","Type":"ContainerStarted","Data":"ed744fafc4b53c6dc5a236972b2fa45937ee44a36b25970f27444d010135a4e3"}
Oct 30 20:00:08.972604 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:08.972544    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc" podStartSLOduration=1.6086860760000001 podStartE2EDuration="8.972526328s" totalImagesPullingTime="7.363840252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:08.969994623 +0000 UTC m=+2071.512801891" watchObservedRunningTime="2026-10-30 20:00:08.972526328 +0000 UTC m=+2071.515333592"
Oct 30 20:00:09.082135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:09.082086    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" podStartSLOduration=2.016681868 podStartE2EDuration="9.082069913s" totalImagesPullingTime="7.065388045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:09.080348524 +0000 UTC m=+2071.623155790" watchObservedRunningTime="2026-10-30 20:00:09.082069913 +0000 UTC m=+2071.624877204"
Oct 30 20:00:09.880477 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:09.880438    6015 generic.go:356] "Generic (PLEG): container finished" podID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerID="ed744fafc4b53c6dc5a236972b2fa45937ee44a36b25970f27444d010135a4e3" exitCode=60
Oct 30 20:00:09.881018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:09.880528    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" event={"ID":"d836c127-db66-4cc7-aff0-840a8cf272f0","Type":"ContainerDied","Data":"ed744fafc4b53c6dc5a236972b2fa45937ee44a36b25970f27444d010135a4e3"}
Oct 30 20:00:09.881018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:09.880799    6015 scope.go:122] "RemoveContainer" containerID="ed744fafc4b53c6dc5a236972b2fa45937ee44a36b25970f27444d010135a4e3"
Oct 30 20:00:09.882558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:09.882530    6015 generic.go:356] "Generic (PLEG): container finished" podID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerID="82ef3e24ba3a37c12ef687b5934cc58a053c301aafa8a5fa854db36335e8d4c7" exitCode=60
Oct 30 20:00:09.882685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:09.882656    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc" event={"ID":"8a52019d-6b02-43bc-a936-cc4ce3027259","Type":"ContainerDied","Data":"82ef3e24ba3a37c12ef687b5934cc58a053c301aafa8a5fa854db36335e8d4c7"}
Oct 30 20:00:09.882940 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:09.882918    6015 scope.go:122] "RemoveContainer" containerID="82ef3e24ba3a37c12ef687b5934cc58a053c301aafa8a5fa854db36335e8d4c7"
Oct 30 20:00:10.382912 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:10.382876    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"]
Oct 30 20:00:10.469450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:10.469353    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"]
Oct 30 20:00:10.738166 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:10.738060    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:10.892374 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:10.892343    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" event={"ID":"d836c127-db66-4cc7-aff0-840a8cf272f0","Type":"ContainerStarted","Data":"607a23dff8fe8d8aee0ac12a32c1bf72fd87bf12f27599c27ec0cb0dc34636df"}
Oct 30 20:00:10.894529 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:10.894505    6015 generic.go:356] "Generic (PLEG): container finished" podID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerID="d37d04371ca16c003bc0f28abecc81b8bcfda9ceab1e8a50a14617ade9b71bae" exitCode=60
Oct 30 20:00:10.894643 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:10.894592    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc" event={"ID":"8a52019d-6b02-43bc-a936-cc4ce3027259","Type":"ContainerDied","Data":"d37d04371ca16c003bc0f28abecc81b8bcfda9ceab1e8a50a14617ade9b71bae"}
Oct 30 20:00:10.894688 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:10.894658    6015 scope.go:122] "RemoveContainer" containerID="82ef3e24ba3a37c12ef687b5934cc58a053c301aafa8a5fa854db36335e8d4c7"
Oct 30 20:00:10.894951 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:10.894934    6015 scope.go:122] "RemoveContainer" containerID="d37d04371ca16c003bc0f28abecc81b8bcfda9ceab1e8a50a14617ade9b71bae"
Oct 30 20:00:10.895310 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:10.895287    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc_odh-ai-gateway-infra(8a52019d-6b02-43bc-a936-cc4ce3027259)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259"
Oct 30 20:00:10.933006 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:10.932962    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:11.895824 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:11.895767    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:11.902609 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:11.902574    6015 scope.go:122] "RemoveContainer" containerID="d37d04371ca16c003bc0f28abecc81b8bcfda9ceab1e8a50a14617ade9b71bae"
Oct 30 20:00:11.902963 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:11.902929    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc_odh-ai-gateway-infra(8a52019d-6b02-43bc-a936-cc4ce3027259)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259"
Oct 30 20:00:11.904080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:11.904059    6015 generic.go:356] "Generic (PLEG): container finished" podID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerID="607a23dff8fe8d8aee0ac12a32c1bf72fd87bf12f27599c27ec0cb0dc34636df" exitCode=60
Oct 30 20:00:11.904178 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:11.904129    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" event={"ID":"d836c127-db66-4cc7-aff0-840a8cf272f0","Type":"ContainerDied","Data":"607a23dff8fe8d8aee0ac12a32c1bf72fd87bf12f27599c27ec0cb0dc34636df"}
Oct 30 20:00:11.904245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:11.904182    6015 scope.go:122] "RemoveContainer" containerID="ed744fafc4b53c6dc5a236972b2fa45937ee44a36b25970f27444d010135a4e3"
Oct 30 20:00:11.904353 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:11.904334    6015 scope.go:122] "RemoveContainer" containerID="607a23dff8fe8d8aee0ac12a32c1bf72fd87bf12f27599c27ec0cb0dc34636df"
Oct 30 20:00:11.904649 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:11.904622    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89_odh-ai-gateway-infra(d836c127-db66-4cc7-aff0-840a8cf272f0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0"
Oct 30 20:00:12.495958 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:12.495921    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:12.713637 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:12.713601    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:12.912161 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:12.912130    6015 scope.go:122] "RemoveContainer" containerID="607a23dff8fe8d8aee0ac12a32c1bf72fd87bf12f27599c27ec0cb0dc34636df"
Oct 30 20:00:12.912564 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:12.912431    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89_odh-ai-gateway-infra(d836c127-db66-4cc7-aff0-840a8cf272f0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0"
Oct 30 20:00:15.119266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.119225    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:15.383571 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.383475    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs" podUID="aebb37f4-5c2f-4be5-844f-8d93852ebad6" containerName="payload-processing" containerID="cri-o://1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4" gracePeriod=25
Oct 30 20:00:15.470589 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.470521    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6" podUID="bbdad561-9d1f-423d-ac08-6b02e4f1748b" containerName="payload-pre-processing" containerID="cri-o://fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef" gracePeriod=25
Oct 30 20:00:15.770072 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.770040    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 20:00:15.802242 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.802207    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 20:00:15.889501 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.889454    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aebb37f4-5c2f-4be5-844f-8d93852ebad6-kube-api-access-9lj29\" (UniqueName: \"kubernetes.io/projected/aebb37f4-5c2f-4be5-844f-8d93852ebad6-kube-api-access-9lj29\") pod \"aebb37f4-5c2f-4be5-844f-8d93852ebad6\" (UID: \"aebb37f4-5c2f-4be5-844f-8d93852ebad6\") "
Oct 30 20:00:15.889711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.889605    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bbdad561-9d1f-423d-ac08-6b02e4f1748b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbdad561-9d1f-423d-ac08-6b02e4f1748b-plugins-config-volume\") pod \"bbdad561-9d1f-423d-ac08-6b02e4f1748b\" (UID: \"bbdad561-9d1f-423d-ac08-6b02e4f1748b\") "
Oct 30 20:00:15.889789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.889726    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aebb37f4-5c2f-4be5-844f-8d93852ebad6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aebb37f4-5c2f-4be5-844f-8d93852ebad6-plugins-config-volume\") pod \"aebb37f4-5c2f-4be5-844f-8d93852ebad6\" (UID: \"aebb37f4-5c2f-4be5-844f-8d93852ebad6\") "
Oct 30 20:00:15.889911 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.889890    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bbdad561-9d1f-423d-ac08-6b02e4f1748b-kube-api-access-xkrzn\" (UniqueName: \"kubernetes.io/projected/bbdad561-9d1f-423d-ac08-6b02e4f1748b-kube-api-access-xkrzn\") pod \"bbdad561-9d1f-423d-ac08-6b02e4f1748b\" (UID: \"bbdad561-9d1f-423d-ac08-6b02e4f1748b\") "
Oct 30 20:00:15.890105 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.890076    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbdad561-9d1f-423d-ac08-6b02e4f1748b-plugins-config-volume" pod "bbdad561-9d1f-423d-ac08-6b02e4f1748b" (UID: "bbdad561-9d1f-423d-ac08-6b02e4f1748b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:00:15.890193 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.890123    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aebb37f4-5c2f-4be5-844f-8d93852ebad6-plugins-config-volume" pod "aebb37f4-5c2f-4be5-844f-8d93852ebad6" (UID: "aebb37f4-5c2f-4be5-844f-8d93852ebad6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:00:15.891026 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.891000    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aebb37f4-5c2f-4be5-844f-8d93852ebad6-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:15.891026 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.891028    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbdad561-9d1f-423d-ac08-6b02e4f1748b-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:15.894882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.894130    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbdad561-9d1f-423d-ac08-6b02e4f1748b-kube-api-access-xkrzn" pod "bbdad561-9d1f-423d-ac08-6b02e4f1748b" (UID: "bbdad561-9d1f-423d-ac08-6b02e4f1748b"). InnerVolumeSpecName "kube-api-access-xkrzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:00:15.894882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.894780    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aebb37f4-5c2f-4be5-844f-8d93852ebad6-kube-api-access-9lj29" pod "aebb37f4-5c2f-4be5-844f-8d93852ebad6" (UID: "aebb37f4-5c2f-4be5-844f-8d93852ebad6"). InnerVolumeSpecName "kube-api-access-9lj29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:00:15.938676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.938597    6015 generic.go:356] "Generic (PLEG): container finished" podID="aebb37f4-5c2f-4be5-844f-8d93852ebad6" containerID="1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4" exitCode=0
Oct 30 20:00:15.938676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.938659    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"
Oct 30 20:00:15.939036 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.938687    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs" event={"ID":"aebb37f4-5c2f-4be5-844f-8d93852ebad6","Type":"ContainerDied","Data":"1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4"}
Oct 30 20:00:15.939036 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.938780    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs" event={"ID":"aebb37f4-5c2f-4be5-844f-8d93852ebad6","Type":"ContainerDied","Data":"e2a8d2647dd6ca5b22e02e70f111c28c4ab440579760b661a2a9cbd7ad27610d"}
Oct 30 20:00:15.939036 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.938838    6015 scope.go:122] "RemoveContainer" containerID="1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4"
Oct 30 20:00:15.940481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.940399    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"
Oct 30 20:00:15.940481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.940399    6015 generic.go:356] "Generic (PLEG): container finished" podID="bbdad561-9d1f-423d-ac08-6b02e4f1748b" containerID="fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef" exitCode=0
Oct 30 20:00:15.940481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.940462    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6" event={"ID":"bbdad561-9d1f-423d-ac08-6b02e4f1748b","Type":"ContainerDied","Data":"fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef"}
Oct 30 20:00:15.940656 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.940534    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6" event={"ID":"bbdad561-9d1f-423d-ac08-6b02e4f1748b","Type":"ContainerDied","Data":"0160a271c45ccf1cd28fb750164e9e54f7f9e8786bbc9953d2228423e895fa95"}
Oct 30 20:00:15.951003 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.950979    6015 scope.go:122] "RemoveContainer" containerID="1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4"
Oct 30 20:00:15.951409 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:15.951376    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4\": container with ID starting with 1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4 not found: ID does not exist" containerID="1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4"
Oct 30 20:00:15.951519 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.951410    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4"} err="failed to get container status \"1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4\": rpc error: code = NotFound desc = could not find container \"1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4\": container with ID starting with 1260384a2dff071442b045b4db2951fd6be3e55c8d35fb80b232abb35a8ebfa4 not found: ID does not exist"
Oct 30 20:00:15.951519 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.951435    6015 scope.go:122] "RemoveContainer" containerID="fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef"
Oct 30 20:00:15.962976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.962953    6015 scope.go:122] "RemoveContainer" containerID="fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef"
Oct 30 20:00:15.963314 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:15.963292    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef\": container with ID starting with fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef not found: ID does not exist" containerID="fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef"
Oct 30 20:00:15.963366 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.963324    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef"} err="failed to get container status \"fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef\": rpc error: code = NotFound desc = could not find container \"fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef\": container with ID starting with fba91b630b1d4b2599224256253d9b455e92d0ccb2250c41299fb9263bb4c8ef not found: ID does not exist"
Oct 30 20:00:15.992838 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.992789    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lj29\" (UniqueName: \"kubernetes.io/projected/aebb37f4-5c2f-4be5-844f-8d93852ebad6-kube-api-access-9lj29\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:15.992838 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:15.992832    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkrzn\" (UniqueName: \"kubernetes.io/projected/bbdad561-9d1f-423d-ac08-6b02e4f1748b-kube-api-access-xkrzn\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:16.113743 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:16.113704    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"]
Oct 30 20:00:16.116948 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:16.116923    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d80c7d-96b4dcdc5-blnd6"]
Oct 30 20:00:16.221249 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:16.221159    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"]
Oct 30 20:00:16.226137 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:16.226104    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d80c7d-798dbf97cb-mk8gs"]
Oct 30 20:00:16.685231 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:16.685194    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:16.891547 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:16.891503    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:17.081999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.081947    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:17.247964 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.247932    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:17.322505 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.322467    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"]
Oct 30 20:00:17.323159 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.323141    6015 cpu_manager.go:414] "containerMap: removing container" podUID="aebb37f4-5c2f-4be5-844f-8d93852ebad6" containerName="payload-processing"
Oct 30 20:00:17.323227 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.323161    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aebb37f4-5c2f-4be5-844f-8d93852ebad6" containerName="payload-processing"
Oct 30 20:00:17.323227 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.323176    6015 cpu_manager.go:414] "containerMap: removing container" podUID="bbdad561-9d1f-423d-ac08-6b02e4f1748b" containerName="payload-pre-processing"
Oct 30 20:00:17.323227 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.323181    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbdad561-9d1f-423d-ac08-6b02e4f1748b" containerName="payload-pre-processing"
Oct 30 20:00:17.323330 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.323314    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="aebb37f4-5c2f-4be5-844f-8d93852ebad6" containerName="payload-processing"
Oct 30 20:00:17.323330 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.323322    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="bbdad561-9d1f-423d-ac08-6b02e4f1748b" containerName="payload-pre-processing"
Oct 30 20:00:17.327005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.326984    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:00:17.384096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.384048    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-8b0edc\""
Oct 30 20:00:17.384096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.384048    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-8b0edc-dockercfg-dwr5v\""
Oct 30 20:00:17.454486 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.443615    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/559e48c6-f016-49dc-a853-2443b81303f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl\" (UID: \"559e48c6-f016-49dc-a853-2443b81303f0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:00:17.454486 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.443908    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qch7s\" (UniqueName: \"kubernetes.io/projected/559e48c6-f016-49dc-a853-2443b81303f0-kube-api-access-qch7s\") pod \"payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl\" (UID: \"559e48c6-f016-49dc-a853-2443b81303f0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:00:17.454486 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.446512    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"]
Oct 30 20:00:17.476832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.475214    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"]
Oct 30 20:00:17.509434 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.509403    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:00:17.538209 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.536402    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"]
Oct 30 20:00:17.545149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.545113    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qch7s\" (UniqueName: \"kubernetes.io/projected/559e48c6-f016-49dc-a853-2443b81303f0-kube-api-access-qch7s\") pod \"payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl\" (UID: \"559e48c6-f016-49dc-a853-2443b81303f0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:00:17.545328 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.545214    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/559e48c6-f016-49dc-a853-2443b81303f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl\" (UID: \"559e48c6-f016-49dc-a853-2443b81303f0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:00:17.546425 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.546337    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/559e48c6-f016-49dc-a853-2443b81303f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl\" (UID: \"559e48c6-f016-49dc-a853-2443b81303f0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:00:17.590526 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.590429    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aebb37f4-5c2f-4be5-844f-8d93852ebad6" path="/var/lib/kubelet/pods/aebb37f4-5c2f-4be5-844f-8d93852ebad6/volumes"
Oct 30 20:00:17.591085 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.591067    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bbdad561-9d1f-423d-ac08-6b02e4f1748b" path="/var/lib/kubelet/pods/bbdad561-9d1f-423d-ac08-6b02e4f1748b/volumes"
Oct 30 20:00:17.604350 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.604316    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qch7s\" (UniqueName: \"kubernetes.io/projected/559e48c6-f016-49dc-a853-2443b81303f0-kube-api-access-qch7s\") pod \"payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl\" (UID: \"559e48c6-f016-49dc-a853-2443b81303f0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:00:17.624401 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.624363    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:17.642704 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.642670    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:00:17.646693 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.646396    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10cce503-9143-49e1-b569-b23b99bd38b9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp\" (UID: \"10cce503-9143-49e1-b569-b23b99bd38b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:00:17.646693 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.646617    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjh8p\" (UniqueName: \"kubernetes.io/projected/10cce503-9143-49e1-b569-b23b99bd38b9-kube-api-access-fjh8p\") pod \"payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp\" (UID: \"10cce503-9143-49e1-b569-b23b99bd38b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:00:17.791854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.767784    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10cce503-9143-49e1-b569-b23b99bd38b9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp\" (UID: \"10cce503-9143-49e1-b569-b23b99bd38b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:00:17.791854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.767941    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjh8p\" (UniqueName: \"kubernetes.io/projected/10cce503-9143-49e1-b569-b23b99bd38b9-kube-api-access-fjh8p\") pod \"payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp\" (UID: \"10cce503-9143-49e1-b569-b23b99bd38b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:00:17.791854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.768950    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10cce503-9143-49e1-b569-b23b99bd38b9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp\" (UID: \"10cce503-9143-49e1-b569-b23b99bd38b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:00:17.801966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.801928    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:17.851889 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:17.851784    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjh8p\" (UniqueName: \"kubernetes.io/projected/10cce503-9143-49e1-b569-b23b99bd38b9-kube-api-access-fjh8p\") pod \"payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp\" (UID: \"10cce503-9143-49e1-b569-b23b99bd38b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:00:18.062046 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.062009    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"]
Oct 30 20:00:18.068256 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:00:18.068224    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559e48c6_f016_49dc_a853_2443b81303f0.slice/crio-44c67732ded254f8d260deaccbf04d344570e14b2d3bf03b85ee5e413cfb3eb6 WatchSource:0}: Error finding container 44c67732ded254f8d260deaccbf04d344570e14b2d3bf03b85ee5e413cfb3eb6: Status 404 returned error can't find the container with id 44c67732ded254f8d260deaccbf04d344570e14b2d3bf03b85ee5e413cfb3eb6
Oct 30 20:00:18.071445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.071413    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"]
Oct 30 20:00:18.098613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.098576    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"]
Oct 30 20:00:18.103219 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.103156    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.142976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.142946    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:00:18.152761 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.152730    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-3f9b9b-openshift-default-dockercfg-76h84\""
Oct 30 20:00:18.161259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.161234    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"]
Oct 30 20:00:18.180921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.180887    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"]
Oct 30 20:00:18.205584 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.205440    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:18.297557 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.297508    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-socket\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.298037 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.297574    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-data\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.298037 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.297729    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ltvg\" (UniqueName: \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-kube-api-access-5ltvg\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.298037 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.297908    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-credential-socket\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.298037 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.297964    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-podinfo\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.298283 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.298122    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-envoy\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.298283 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.298225    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-token\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.298395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.298278    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bedde921-8b8e-485f-a7ce-ef571614f46c-istiod-ca-cert\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.298395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.298341    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-certs\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.446886    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.449343    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-envoy\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.449432    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-token\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.449478    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bedde921-8b8e-485f-a7ce-ef571614f46c-istiod-ca-cert\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.449512    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-certs\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.449571    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-socket\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.449614    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-data\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.449682    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ltvg\" (UniqueName: \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-kube-api-access-5ltvg\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.449786    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-credential-socket\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.449868    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-podinfo\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.450383    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bedde921-8b8e-485f-a7ce-ef571614f46c-istiod-ca-cert\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.451741    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-data\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.452195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.451998    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-certs\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.454575 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.454536    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-socket\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.455261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.455239    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-credential-socket\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.458767 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.458745    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-envoy\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.458937 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.458758    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-podinfo\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.526142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.525980    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ltvg\" (UniqueName: \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-kube-api-access-5ltvg\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.527728 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.527705    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-token\") pod \"e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") " pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.558128 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.558094    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"]
Oct 30 20:00:18.563679 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:00:18.563652    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10cce503_9143_49e1_b569_b23b99bd38b9.slice/crio-33183846b2d07ddfae4936d7a09f2e34845d38ec47a7bfceaf4ce36ef8efd50c WatchSource:0}: Error finding container 33183846b2d07ddfae4936d7a09f2e34845d38ec47a7bfceaf4ce36ef8efd50c: Status 404 returned error can't find the container with id 33183846b2d07ddfae4936d7a09f2e34845d38ec47a7bfceaf4ce36ef8efd50c
Oct 30 20:00:18.598987 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.598940    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:18.721000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.720904    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:18.963054 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.963017    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl" event={"ID":"559e48c6-f016-49dc-a853-2443b81303f0","Type":"ContainerStarted","Data":"e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481"}
Oct 30 20:00:18.963255 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.963076    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:00:18.963255 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.963097    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl" event={"ID":"559e48c6-f016-49dc-a853-2443b81303f0","Type":"ContainerStarted","Data":"44c67732ded254f8d260deaccbf04d344570e14b2d3bf03b85ee5e413cfb3eb6"}
Oct 30 20:00:18.964709 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.964680    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp" event={"ID":"10cce503-9143-49e1-b569-b23b99bd38b9","Type":"ContainerStarted","Data":"8c46ceaa4d58243eb65eacf9f1c0aab9541399c0d3a2b854e822b99af1591c50"}
Oct 30 20:00:18.964823 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.964726    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp" event={"ID":"10cce503-9143-49e1-b569-b23b99bd38b9","Type":"ContainerStarted","Data":"33183846b2d07ddfae4936d7a09f2e34845d38ec47a7bfceaf4ce36ef8efd50c"}
Oct 30 20:00:18.964823 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:18.964746    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:00:19.082667 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:19.082619    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl" podStartSLOduration=2.08260465 podStartE2EDuration="2.08260465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:19.082153652 +0000 UTC m=+2081.624960917" watchObservedRunningTime="2026-10-30 20:00:19.08260465 +0000 UTC m=+2081.625411914"
Oct 30 20:00:19.159124 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:19.159077    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"]
Oct 30 20:00:19.164409 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:00:19.164376    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbedde921_8b8e_485f_a7ce_ef571614f46c.slice/crio-328fde2965e3b69a495eaed4fb200962517051f2585bd225674ab808194ad183 WatchSource:0}: Error finding container 328fde2965e3b69a495eaed4fb200962517051f2585bd225674ab808194ad183: Status 404 returned error can't find the container with id 328fde2965e3b69a495eaed4fb200962517051f2585bd225674ab808194ad183
Oct 30 20:00:19.167589 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:19.167536    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:00:19.167698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:19.167643    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:00:19.167698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:19.167683    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:00:19.196039 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:19.195925    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp" podStartSLOduration=2.195902563 podStartE2EDuration="2.195902563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:19.191983361 +0000 UTC m=+2081.734790628" watchObservedRunningTime="2026-10-30 20:00:19.195902563 +0000 UTC m=+2081.738709828"
Oct 30 20:00:19.975524 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:19.975480    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" event={"ID":"bedde921-8b8e-485f-a7ce-ef571614f46c","Type":"ContainerStarted","Data":"e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c"}
Oct 30 20:00:19.975524 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:19.975530    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" event={"ID":"bedde921-8b8e-485f-a7ce-ef571614f46c","Type":"ContainerStarted","Data":"328fde2965e3b69a495eaed4fb200962517051f2585bd225674ab808194ad183"}
Oct 30 20:00:20.089600 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:20.089408    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" podStartSLOduration=2.089388489 podStartE2EDuration="2.089388489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:20.088921751 +0000 UTC m=+2082.631729055" watchObservedRunningTime="2026-10-30 20:00:20.089388489 +0000 UTC m=+2082.632195754"
Oct 30 20:00:20.721258 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:20.721220    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:20.727287 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:20.727257    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:20.991233 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:20.991138    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:20.992527 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:20.992493    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:00:21.577742 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:21.577709    6015 scope.go:122] "RemoveContainer" containerID="607a23dff8fe8d8aee0ac12a32c1bf72fd87bf12f27599c27ec0cb0dc34636df"
Oct 30 20:00:22.000769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:22.000720    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" event={"ID":"d836c127-db66-4cc7-aff0-840a8cf272f0","Type":"ContainerStarted","Data":"04f98000a68ca6382bb260f569b60eda7008b9ad5837435e44d61fb725db7f5f"}
Oct 30 20:00:22.437454 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:22.437412    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:23.009608 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.009573    6015 generic.go:356] "Generic (PLEG): container finished" podID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerID="04f98000a68ca6382bb260f569b60eda7008b9ad5837435e44d61fb725db7f5f" exitCode=60
Oct 30 20:00:23.010123 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.009644    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" event={"ID":"d836c127-db66-4cc7-aff0-840a8cf272f0","Type":"ContainerDied","Data":"04f98000a68ca6382bb260f569b60eda7008b9ad5837435e44d61fb725db7f5f"}
Oct 30 20:00:23.010123 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.009705    6015 scope.go:122] "RemoveContainer" containerID="607a23dff8fe8d8aee0ac12a32c1bf72fd87bf12f27599c27ec0cb0dc34636df"
Oct 30 20:00:23.010259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.010222    6015 scope.go:122] "RemoveContainer" containerID="04f98000a68ca6382bb260f569b60eda7008b9ad5837435e44d61fb725db7f5f"
Oct 30 20:00:23.010613 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:23.010584    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89_odh-ai-gateway-infra(d836c127-db66-4cc7-aff0-840a8cf272f0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0"
Oct 30 20:00:23.072103 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.072054    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp" podUID="355f9df6-1f21-4167-88a2-624cfd3812b1" containerName="payload-processing" containerID="cri-o://5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6" gracePeriod=25
Oct 30 20:00:23.127214 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.127176    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"]
Oct 30 20:00:23.182098 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.182056    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2" podUID="8b814d23-7343-4d5e-80e0-d024bf78677d" containerName="payload-pre-processing" containerID="cri-o://d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143" gracePeriod=25
Oct 30 20:00:23.362335 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.362303    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 20:00:23.448779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.447852    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/355f9df6-1f21-4167-88a2-624cfd3812b1-kube-api-access-bl52x\" (UniqueName: \"kubernetes.io/projected/355f9df6-1f21-4167-88a2-624cfd3812b1-kube-api-access-bl52x\") pod \"355f9df6-1f21-4167-88a2-624cfd3812b1\" (UID: \"355f9df6-1f21-4167-88a2-624cfd3812b1\") "
Oct 30 20:00:23.448779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.447930    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/355f9df6-1f21-4167-88a2-624cfd3812b1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/355f9df6-1f21-4167-88a2-624cfd3812b1-plugins-config-volume\") pod \"355f9df6-1f21-4167-88a2-624cfd3812b1\" (UID: \"355f9df6-1f21-4167-88a2-624cfd3812b1\") "
Oct 30 20:00:23.449577 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.449525    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/355f9df6-1f21-4167-88a2-624cfd3812b1-plugins-config-volume" pod "355f9df6-1f21-4167-88a2-624cfd3812b1" (UID: "355f9df6-1f21-4167-88a2-624cfd3812b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:00:23.464963 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.464902    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/355f9df6-1f21-4167-88a2-624cfd3812b1-kube-api-access-bl52x" pod "355f9df6-1f21-4167-88a2-624cfd3812b1" (UID: "355f9df6-1f21-4167-88a2-624cfd3812b1"). InnerVolumeSpecName "kube-api-access-bl52x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:00:23.511168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.511137    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 20:00:23.549489 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.549406    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl52x\" (UniqueName: \"kubernetes.io/projected/355f9df6-1f21-4167-88a2-624cfd3812b1-kube-api-access-bl52x\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:23.549489 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.549437    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/355f9df6-1f21-4167-88a2-624cfd3812b1-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:23.650636 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.650601    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8b814d23-7343-4d5e-80e0-d024bf78677d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b814d23-7343-4d5e-80e0-d024bf78677d-plugins-config-volume\") pod \"8b814d23-7343-4d5e-80e0-d024bf78677d\" (UID: \"8b814d23-7343-4d5e-80e0-d024bf78677d\") "
Oct 30 20:00:23.650892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.650875    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b814d23-7343-4d5e-80e0-d024bf78677d-kube-api-access-wjhqj\" (UniqueName: \"kubernetes.io/projected/8b814d23-7343-4d5e-80e0-d024bf78677d-kube-api-access-wjhqj\") pod \"8b814d23-7343-4d5e-80e0-d024bf78677d\" (UID: \"8b814d23-7343-4d5e-80e0-d024bf78677d\") "
Oct 30 20:00:23.651726 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.651702    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b814d23-7343-4d5e-80e0-d024bf78677d-plugins-config-volume" pod "8b814d23-7343-4d5e-80e0-d024bf78677d" (UID: "8b814d23-7343-4d5e-80e0-d024bf78677d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:00:23.653960 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.653932    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b814d23-7343-4d5e-80e0-d024bf78677d-kube-api-access-wjhqj" pod "8b814d23-7343-4d5e-80e0-d024bf78677d" (UID: "8b814d23-7343-4d5e-80e0-d024bf78677d"). InnerVolumeSpecName "kube-api-access-wjhqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:00:23.697127 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.697081    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:23.752793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.752753    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjhqj\" (UniqueName: \"kubernetes.io/projected/8b814d23-7343-4d5e-80e0-d024bf78677d-kube-api-access-wjhqj\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:23.752793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.752788    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b814d23-7343-4d5e-80e0-d024bf78677d-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:23.929916 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:23.929712    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:24.017646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.017609    6015 generic.go:356] "Generic (PLEG): container finished" podID="8b814d23-7343-4d5e-80e0-d024bf78677d" containerID="d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143" exitCode=0
Oct 30 20:00:24.018198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.017656    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"
Oct 30 20:00:24.018198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.017659    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2" event={"ID":"8b814d23-7343-4d5e-80e0-d024bf78677d","Type":"ContainerDied","Data":"d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143"}
Oct 30 20:00:24.018198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.017724    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2" event={"ID":"8b814d23-7343-4d5e-80e0-d024bf78677d","Type":"ContainerDied","Data":"a5bffc73ba4cd59590798467a2a5381f5b94cbf4598afce54ebef7678206a9db"}
Oct 30 20:00:24.018198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.017760    6015 scope.go:122] "RemoveContainer" containerID="d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143"
Oct 30 20:00:24.021372 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.021348    6015 generic.go:356] "Generic (PLEG): container finished" podID="355f9df6-1f21-4167-88a2-624cfd3812b1" containerID="5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6" exitCode=0
Oct 30 20:00:24.021478 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.021402    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"
Oct 30 20:00:24.021478 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.021426    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp" event={"ID":"355f9df6-1f21-4167-88a2-624cfd3812b1","Type":"ContainerDied","Data":"5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6"}
Oct 30 20:00:24.021584 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.021486    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp" event={"ID":"355f9df6-1f21-4167-88a2-624cfd3812b1","Type":"ContainerDied","Data":"b3cebb27c45ea720b8855677c57b8ef027d3d43e0373f210e2473b238290fd72"}
Oct 30 20:00:24.030778 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.030759    6015 scope.go:122] "RemoveContainer" containerID="d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143"
Oct 30 20:00:24.031125 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:24.031100    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143\": container with ID starting with d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143 not found: ID does not exist" containerID="d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143"
Oct 30 20:00:24.031235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.031137    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143"} err="failed to get container status \"d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143\": rpc error: code = NotFound desc = could not find container \"d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143\": container with ID starting with d9b5113015ce9596dd6ab3c88fe2a4a80bdf8ab05546ff671e12889bb9e65143 not found: ID does not exist"
Oct 30 20:00:24.031235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.031163    6015 scope.go:122] "RemoveContainer" containerID="5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6"
Oct 30 20:00:24.043215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.043181    6015 scope.go:122] "RemoveContainer" containerID="5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6"
Oct 30 20:00:24.043636 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:24.043610    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6\": container with ID starting with 5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6 not found: ID does not exist" containerID="5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6"
Oct 30 20:00:24.043733 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.043643    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6"} err="failed to get container status \"5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6\": rpc error: code = NotFound desc = could not find container \"5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6\": container with ID starting with 5422bacd247c535a6b3aea5c544ca00412e1f704a970ba30b5bd2342265580c6 not found: ID does not exist"
Oct 30 20:00:24.216583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.216494    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:24.260361 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.260328    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"
Oct 30 20:00:24.311125 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.311088    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"]
Oct 30 20:00:24.313647 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.313622    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a299b8-69d9ff7846-sxnjp"]
Oct 30 20:00:24.376800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.376765    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d836c127-db66-4cc7-aff0-840a8cf272f0-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d836c127-db66-4cc7-aff0-840a8cf272f0-maas-api-service-ca\") pod \"d836c127-db66-4cc7-aff0-840a8cf272f0\" (UID: \"d836c127-db66-4cc7-aff0-840a8cf272f0\") "
Oct 30 20:00:24.377020 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.376988    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d836c127-db66-4cc7-aff0-840a8cf272f0-kube-api-access-6z9tz\" (UniqueName: \"kubernetes.io/projected/d836c127-db66-4cc7-aff0-840a8cf272f0-kube-api-access-6z9tz\") pod \"d836c127-db66-4cc7-aff0-840a8cf272f0\" (UID: \"d836c127-db66-4cc7-aff0-840a8cf272f0\") "
Oct 30 20:00:24.377197 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.377170    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d836c127-db66-4cc7-aff0-840a8cf272f0-maas-api-service-ca" pod "d836c127-db66-4cc7-aff0-840a8cf272f0" (UID: "d836c127-db66-4cc7-aff0-840a8cf272f0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:00:24.377476 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.377459    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d836c127-db66-4cc7-aff0-840a8cf272f0-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:24.379341 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.379319    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d836c127-db66-4cc7-aff0-840a8cf272f0-kube-api-access-6z9tz" pod "d836c127-db66-4cc7-aff0-840a8cf272f0" (UID: "d836c127-db66-4cc7-aff0-840a8cf272f0"). InnerVolumeSpecName "kube-api-access-6z9tz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:00:24.445883 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.444196    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"]
Oct 30 20:00:24.449831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.446721    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a299b8-6c88c7ffdc-qttq2"]
Oct 30 20:00:24.479304 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.479209    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z9tz\" (UniqueName: \"kubernetes.io/projected/d836c127-db66-4cc7-aff0-840a8cf272f0-kube-api-access-6z9tz\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:24.564023 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.563983    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:24.577737 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.577710    6015 scope.go:122] "RemoveContainer" containerID="d37d04371ca16c003bc0f28abecc81b8bcfda9ceab1e8a50a14617ade9b71bae"
Oct 30 20:00:24.742970 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.742860    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:24.952167 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:24.952134    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:25.038999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.038910    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"
Oct 30 20:00:25.038999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.038941    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89" event={"ID":"d836c127-db66-4cc7-aff0-840a8cf272f0","Type":"ContainerDied","Data":"0ff51f136a9f0dfdd1e32b9853bf654df338e80faa2bbc4d5355e1275da455e1"}
Oct 30 20:00:25.039525 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.039040    6015 scope.go:122] "RemoveContainer" containerID="04f98000a68ca6382bb260f569b60eda7008b9ad5837435e44d61fb725db7f5f"
Oct 30 20:00:25.042707 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.042677    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc" event={"ID":"8a52019d-6b02-43bc-a936-cc4ce3027259","Type":"ContainerStarted","Data":"1cfc79d60d6e03dba9e44fa5340074c2509a4798dbfcc8b9896f77a680ca71cc"}
Oct 30 20:00:25.123490 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.123447    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:25.316494 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.315418    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"]
Oct 30 20:00:25.339844 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.316932    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889840-8bh89"]
Oct 30 20:00:25.370483 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.370447    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:25.585022 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.584922    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:25.586881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.586854    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="355f9df6-1f21-4167-88a2-624cfd3812b1" path="/var/lib/kubelet/pods/355f9df6-1f21-4167-88a2-624cfd3812b1/volumes"
Oct 30 20:00:25.587298 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.587285    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8b814d23-7343-4d5e-80e0-d024bf78677d" path="/var/lib/kubelet/pods/8b814d23-7343-4d5e-80e0-d024bf78677d/volumes"
Oct 30 20:00:25.587644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:25.587632    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0" path="/var/lib/kubelet/pods/d836c127-db66-4cc7-aff0-840a8cf272f0/volumes"
Oct 30 20:00:26.050819 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.050782    6015 generic.go:356] "Generic (PLEG): container finished" podID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerID="1cfc79d60d6e03dba9e44fa5340074c2509a4798dbfcc8b9896f77a680ca71cc" exitCode=60
Oct 30 20:00:26.051292 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.050855    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc" event={"ID":"8a52019d-6b02-43bc-a936-cc4ce3027259","Type":"ContainerDied","Data":"1cfc79d60d6e03dba9e44fa5340074c2509a4798dbfcc8b9896f77a680ca71cc"}
Oct 30 20:00:26.051292 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.050915    6015 scope.go:122] "RemoveContainer" containerID="d37d04371ca16c003bc0f28abecc81b8bcfda9ceab1e8a50a14617ade9b71bae"
Oct 30 20:00:26.051412 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.051365    6015 scope.go:122] "RemoveContainer" containerID="1cfc79d60d6e03dba9e44fa5340074c2509a4798dbfcc8b9896f77a680ca71cc"
Oct 30 20:00:26.051747 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:26.051719    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc_odh-ai-gateway-infra(8a52019d-6b02-43bc-a936-cc4ce3027259)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259"
Oct 30 20:00:26.222529 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.222490    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"]
Oct 30 20:00:26.225845 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.224720    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:26.947227 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.947189    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"]
Oct 30 20:00:26.947897 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.947880    6015 cpu_manager.go:414] "containerMap: removing container" podUID="8b814d23-7343-4d5e-80e0-d024bf78677d" containerName="payload-pre-processing"
Oct 30 20:00:26.947953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.947897    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b814d23-7343-4d5e-80e0-d024bf78677d" containerName="payload-pre-processing"
Oct 30 20:00:26.947953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.947947    6015 cpu_manager.go:414] "containerMap: removing container" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerName="cleanup"
Oct 30 20:00:26.948029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.947953    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerName="cleanup"
Oct 30 20:00:26.948029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.947967    6015 cpu_manager.go:414] "containerMap: removing container" podUID="355f9df6-1f21-4167-88a2-624cfd3812b1" containerName="payload-processing"
Oct 30 20:00:26.948029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.947972    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="355f9df6-1f21-4167-88a2-624cfd3812b1" containerName="payload-processing"
Oct 30 20:00:26.948029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.947982    6015 cpu_manager.go:414] "containerMap: removing container" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerName="cleanup"
Oct 30 20:00:26.948029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.947986    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerName="cleanup"
Oct 30 20:00:26.948029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.947998    6015 cpu_manager.go:414] "containerMap: removing container" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerName="cleanup"
Oct 30 20:00:26.948029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.948004    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerName="cleanup"
Oct 30 20:00:26.948240 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.948090    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerName="cleanup"
Oct 30 20:00:26.948240 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.948099    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="355f9df6-1f21-4167-88a2-624cfd3812b1" containerName="payload-processing"
Oct 30 20:00:26.948240 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.948111    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerName="cleanup"
Oct 30 20:00:26.948240 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.948117    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b814d23-7343-4d5e-80e0-d024bf78677d" containerName="payload-pre-processing"
Oct 30 20:00:26.951502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:26.951477    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.001118 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.001084    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-eaa6d2-openshift-default-dockercfg-r8tnf\""
Oct 30 20:00:27.044222 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.044183    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:27.050787 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.050756    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"]
Oct 30 20:00:27.129011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.126903    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istiod-ca-cert\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.129011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.127057    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-token\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.129011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.127205    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-credential-socket\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.129011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.127270    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-data\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.129011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.127295    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-socket\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.129011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.127352    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-podinfo\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.129011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.127401    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-certs\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.129011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.127442    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx8k5\" (UniqueName: \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-kube-api-access-sx8k5\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.129011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.127500    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-envoy\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.228662 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.228631    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-envoy\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.228863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.228707    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istiod-ca-cert\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.228863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.228741    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-token\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.228863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.228852    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-credential-socket\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.229045 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.228898    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-data\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.229045 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.228925    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-socket\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.229045 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.228978    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-podinfo\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.229045 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.229037    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-certs\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.229240 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.229147    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx8k5\" (UniqueName: \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-kube-api-access-sx8k5\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.229240 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.229234    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-credential-socket\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.229432 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.229408    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-socket\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.229505 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.229491    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-data\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.229738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.229706    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-certs\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.230173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.230150    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istiod-ca-cert\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.231375 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.231350    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-envoy\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.231872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.231854    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-podinfo\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.253580 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.253553    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"
Oct 30 20:00:27.309983 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.309952    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx8k5\" (UniqueName: \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-kube-api-access-sx8k5\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.310138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.310102    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-token\") pod \"e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") " pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:27.364482 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.364447    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:27.431977 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.431940    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a52019d-6b02-43bc-a936-cc4ce3027259-kube-api-access-btzw8\" (UniqueName: \"kubernetes.io/projected/8a52019d-6b02-43bc-a936-cc4ce3027259-kube-api-access-btzw8\") pod \"8a52019d-6b02-43bc-a936-cc4ce3027259\" (UID: \"8a52019d-6b02-43bc-a936-cc4ce3027259\") "
Oct 30 20:00:27.432203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.432049    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a52019d-6b02-43bc-a936-cc4ce3027259-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a52019d-6b02-43bc-a936-cc4ce3027259-maas-api-service-ca\") pod \"8a52019d-6b02-43bc-a936-cc4ce3027259\" (UID: \"8a52019d-6b02-43bc-a936-cc4ce3027259\") "
Oct 30 20:00:27.432460 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.432432    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a52019d-6b02-43bc-a936-cc4ce3027259-maas-api-service-ca" pod "8a52019d-6b02-43bc-a936-cc4ce3027259" (UID: "8a52019d-6b02-43bc-a936-cc4ce3027259"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:00:27.432734 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.432717    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a52019d-6b02-43bc-a936-cc4ce3027259-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:27.434399 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.434373    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a52019d-6b02-43bc-a936-cc4ce3027259-kube-api-access-btzw8" pod "8a52019d-6b02-43bc-a936-cc4ce3027259" (UID: "8a52019d-6b02-43bc-a936-cc4ce3027259"). InnerVolumeSpecName "kube-api-access-btzw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:00:27.534262 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.534161    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btzw8\" (UniqueName: \"kubernetes.io/projected/8a52019d-6b02-43bc-a936-cc4ce3027259-kube-api-access-btzw8\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:00:27.547087 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.547053    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:27.576832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:27.576698    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:28.059307 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:28.059269    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"]
Oct 30 20:00:28.064460 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:00:28.064423    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc8f7e8_5437_4ad2_bbc8_ceeabf5e739a.slice/crio-bc39f2e6febb303c8e60b8b63fe8bf185b327bdac04ddc9f49dfa951c3cb7e3f WatchSource:0}: Error finding container bc39f2e6febb303c8e60b8b63fe8bf185b327bdac04ddc9f49dfa951c3cb7e3f: Status 404 returned error can't find the container with id bc39f2e6febb303c8e60b8b63fe8bf185b327bdac04ddc9f49dfa951c3cb7e3f
Oct 30 20:00:28.067485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:28.067452    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:00:28.067583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:28.067524    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:00:28.067583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:28.067553    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:00:28.071886 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:28.071864    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"
Oct 30 20:00:28.071996 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:28.071882    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc" event={"ID":"8a52019d-6b02-43bc-a936-cc4ce3027259","Type":"ContainerDied","Data":"9be62cc00a1f91a5f67fb0fd4488e82273fa7725b769794de8158d57eeb3aa22"}
Oct 30 20:00:28.071996 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:28.071956    6015 scope.go:122] "RemoveContainer" containerID="1cfc79d60d6e03dba9e44fa5340074c2509a4798dbfcc8b9896f77a680ca71cc"
Oct 30 20:00:28.231048 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:28.231016    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:00:28.242572 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:28.242499    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"]
Oct 30 20:00:28.244395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:28.244356    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-a299b8-29889840-xk2pc"]
Oct 30 20:00:29.085016 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:29.084973    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" event={"ID":"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a","Type":"ContainerStarted","Data":"22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02"}
Oct 30 20:00:29.085215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:29.085077    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" event={"ID":"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a","Type":"ContainerStarted","Data":"bc39f2e6febb303c8e60b8b63fe8bf185b327bdac04ddc9f49dfa951c3cb7e3f"}
Oct 30 20:00:29.222444 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:29.222388    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" podStartSLOduration=3.222371041 podStartE2EDuration="3.222371041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:00:29.221293896 +0000 UTC m=+2091.764101181" watchObservedRunningTime="2026-10-30 20:00:29.222371041 +0000 UTC m=+2091.765178306"
Oct 30 20:00:29.588059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:29.588020    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259" path="/var/lib/kubelet/pods/8a52019d-6b02-43bc-a936-cc4ce3027259/volumes"
Oct 30 20:00:29.588558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:29.588457    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:29.589579 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:29.589555    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:29.978684 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:29.978593    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:00:29.979800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:29.979772    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:00:30.092592 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:30.092557    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:30.093645 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:30.093623    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:00:30.255061 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:30.254952    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:31.984678 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:31.984640    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:32.314664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:32.314610    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:32.477833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:32.474313    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:33.336827 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:33.336758    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:34.031576 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:34.031530    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:34.392480 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:34.392427    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:35.381854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:35.381790    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:35.579138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:35.579101    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:36.038553 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:36.038506    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:39.067248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:39.067205    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:39.284142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:39.284108    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:39.434667 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:39.434562    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:41.898637 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:41.898601    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:42.390836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:42.390783    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:42.605497 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:42.605462    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:47.868342 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:47.868280    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:50.815974 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:50.815934    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:52.068624 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:52.068589    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:52.581800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:52.581759    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:55.339107 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:00:55.339062    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:00:58.218881 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:00:58.218839    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:01:00.631665 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:00.631624    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:03.831908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:03.831870    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:04.707183 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:04.707146    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:04.859981 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:04.859949    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:05.276897 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.276786    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"]
Oct 30 20:01:05.277570 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.277548    6015 cpu_manager.go:414] "containerMap: removing container" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerName="cleanup"
Oct 30 20:01:05.277570 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.277570    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerName="cleanup"
Oct 30 20:01:05.277745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.277621    6015 cpu_manager.go:414] "containerMap: removing container" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerName="cleanup"
Oct 30 20:01:05.277745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.277629    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerName="cleanup"
Oct 30 20:01:05.277745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.277641    6015 cpu_manager.go:414] "containerMap: removing container" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerName="cleanup"
Oct 30 20:01:05.277745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.277648    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerName="cleanup"
Oct 30 20:01:05.277979 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.277847    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerName="cleanup"
Oct 30 20:01:05.277979 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.277860    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="d836c127-db66-4cc7-aff0-840a8cf272f0" containerName="cleanup"
Oct 30 20:01:05.277979 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.277879    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerName="cleanup"
Oct 30 20:01:05.281116 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.281094    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.327546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.327507    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:05.330777 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.330735    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-77a92c-openshift-default-dockercfg-xhbd5\""
Oct 30 20:01:05.381113 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.381077    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"]
Oct 30 20:01:05.408234 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.408187    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-token\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.408413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.408341    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqb7z\" (UniqueName: \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-kube-api-access-tqb7z\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.408413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.408391    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-podinfo\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.408540 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.408517    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-envoy\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.408664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.408645    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-certs\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.408752 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.408731    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-data\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.408871 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.408852    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istiod-ca-cert\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.408979 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.408953    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-credential-socket\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.409116 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.409092    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-socket\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.502533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.502482    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:05.516092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.513405    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-podinfo\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.516092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.513481    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-envoy\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.516092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.513566    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-certs\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.516092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.513597    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-data\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.516092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.513666    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istiod-ca-cert\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.516092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.513694    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-credential-socket\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.516092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.513777    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-socket\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.516092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.513856    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-token\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.516092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.513931    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqb7z\" (UniqueName: \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-kube-api-access-tqb7z\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.517866 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.517731    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istiod-ca-cert\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.518649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.518614    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-socket\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.518921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.518896    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-credential-socket\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.519115 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.519095    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-certs\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.519500 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.519479    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-data\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.526487 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.525701    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-podinfo\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.530896 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.530773    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-envoy\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.574598 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.574562    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqb7z\" (UniqueName: \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-kube-api-access-tqb7z\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.577370 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.577337    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-token\") pod \"e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") " pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.612882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.610181    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:05.660171 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:05.660137    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:06.053280 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:06.053241    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"]
Oct 30 20:01:06.058664 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:01:06.058633    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a6c8f6_c1b1_4622_a9e3_86766dc96e97.slice/crio-14da8c317937dfb7c11363860003e4791c4a973394c453357452f86043222319 WatchSource:0}: Error finding container 14da8c317937dfb7c11363860003e4791c4a973394c453357452f86043222319: Status 404 returned error can't find the container with id 14da8c317937dfb7c11363860003e4791c4a973394c453357452f86043222319
Oct 30 20:01:06.061463 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:06.061430    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:01:06.061552 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:06.061496    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:01:06.061552 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:06.061523    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:01:06.359716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:06.359620    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" event={"ID":"96a6c8f6-c1b1-4622-a9e3-86766dc96e97","Type":"ContainerStarted","Data":"034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a"}
Oct 30 20:01:06.359716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:06.359698    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" event={"ID":"96a6c8f6-c1b1-4622-a9e3-86766dc96e97","Type":"ContainerStarted","Data":"14da8c317937dfb7c11363860003e4791c4a973394c453357452f86043222319"}
Oct 30 20:01:06.475457 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:06.475398    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" podStartSLOduration=1.475382324 podStartE2EDuration="1.475382324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:01:06.474363395 +0000 UTC m=+2129.017170661" watchObservedRunningTime="2026-10-30 20:01:06.475382324 +0000 UTC m=+2129.018189589"
Oct 30 20:01:06.614898 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:06.611676    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:07.056356 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:07.056318    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"]
Oct 30 20:01:07.291631 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:07.291594    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:07.495533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:07.494385    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:07.617580 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:07.617549    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:08.169969 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:08.169931    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:08.390001 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:08.389969    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:08.390956 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:08.390929    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:01:08.404020 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:08.403977    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:08.566902 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:08.566865    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:11.291983 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:11.291943    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:11.504697 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:11.504666    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:12.057415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.057375    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w" podUID="b7e7ba59-738b-4209-89b9-f2f9710ace9c" containerName="payload-pre-processing" containerID="cri-o://84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695" gracePeriod=25
Oct 30 20:01:12.358519 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.358486    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 20:01:12.417613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.417574    6015 generic.go:356] "Generic (PLEG): container finished" podID="b7e7ba59-738b-4209-89b9-f2f9710ace9c" containerID="84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695" exitCode=0
Oct 30 20:01:12.417854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.417619    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"
Oct 30 20:01:12.417854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.417649    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w" event={"ID":"b7e7ba59-738b-4209-89b9-f2f9710ace9c","Type":"ContainerDied","Data":"84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695"}
Oct 30 20:01:12.417854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.417701    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w" event={"ID":"b7e7ba59-738b-4209-89b9-f2f9710ace9c","Type":"ContainerDied","Data":"650a11186ac210973f1789a459f115ae812ed2d921bd713b81edd2e93edb0bc9"}
Oct 30 20:01:12.417854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.417722    6015 scope.go:122] "RemoveContainer" containerID="84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695"
Oct 30 20:01:12.429279 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.429257    6015 scope.go:122] "RemoveContainer" containerID="84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695"
Oct 30 20:01:12.429620 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:01:12.429599    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695\": container with ID starting with 84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695 not found: ID does not exist" containerID="84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695"
Oct 30 20:01:12.429711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.429632    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695"} err="failed to get container status \"84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695\": rpc error: code = NotFound desc = could not find container \"84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695\": container with ID starting with 84edf16b767192fb83a230660c5c895a281066a6056d28391f5357944bb60695 not found: ID does not exist"
Oct 30 20:01:12.535924 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.535887    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b7e7ba59-738b-4209-89b9-f2f9710ace9c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7e7ba59-738b-4209-89b9-f2f9710ace9c-plugins-config-volume\") pod \"b7e7ba59-738b-4209-89b9-f2f9710ace9c\" (UID: \"b7e7ba59-738b-4209-89b9-f2f9710ace9c\") "
Oct 30 20:01:12.536166 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.536151    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7e7ba59-738b-4209-89b9-f2f9710ace9c-kube-api-access-j6fhq\" (UniqueName: \"kubernetes.io/projected/b7e7ba59-738b-4209-89b9-f2f9710ace9c-kube-api-access-j6fhq\") pod \"b7e7ba59-738b-4209-89b9-f2f9710ace9c\" (UID: \"b7e7ba59-738b-4209-89b9-f2f9710ace9c\") "
Oct 30 20:01:12.536229 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.536188    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7e7ba59-738b-4209-89b9-f2f9710ace9c-plugins-config-volume" pod "b7e7ba59-738b-4209-89b9-f2f9710ace9c" (UID: "b7e7ba59-738b-4209-89b9-f2f9710ace9c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:01:12.536722 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.536702    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7e7ba59-738b-4209-89b9-f2f9710ace9c-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:01:12.538448 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.538425    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7e7ba59-738b-4209-89b9-f2f9710ace9c-kube-api-access-j6fhq" pod "b7e7ba59-738b-4209-89b9-f2f9710ace9c" (UID: "b7e7ba59-738b-4209-89b9-f2f9710ace9c"). InnerVolumeSpecName "kube-api-access-j6fhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:01:12.637972 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.637867    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6fhq\" (UniqueName: \"kubernetes.io/projected/b7e7ba59-738b-4209-89b9-f2f9710ace9c-kube-api-access-j6fhq\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:01:12.834262 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.834217    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"]
Oct 30 20:01:12.881057 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:12.881026    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-855f5b87-j9p9w"]
Oct 30 20:01:13.587906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:13.587867    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7e7ba59-738b-4209-89b9-f2f9710ace9c" path="/var/lib/kubelet/pods/b7e7ba59-738b-4209-89b9-f2f9710ace9c/volumes"
Oct 30 20:01:13.905011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:13.904909    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:15.047480 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:15.047437    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:15.245737 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:15.245693    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:17.108587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:17.108547    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:17.377991 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:17.377876    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:19.011299 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:19.011253    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:24.206093 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:24.206053    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:24.419710 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:24.419670    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:24.668328 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:24.668266    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:28.219454 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:01:28.219414    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:01:29.587040 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:29.587005    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:34.593334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:34.593292    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:34.764044 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:34.764000    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:34.950185 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:34.950084    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:39.918398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:39.918356    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:45.073732 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:45.073672    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:50.062023 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:50.061913    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:50.392549 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:50.392448    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:51.116410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:51.116368    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:55.342035 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:01:55.341991    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:01:58.246170 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:01:58.246130    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:02:00.607402 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:00.607363    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:01.136022 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:01.135975    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:02:01.136206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:01.136076    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:02:02.943658 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:02.943616    6015 generic.go:356] "Generic (PLEG): container finished" podID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerID="22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02" exitCode=0
Oct 30 20:02:02.944139 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:02.943682    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" event={"ID":"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a","Type":"ContainerDied","Data":"22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02"}
Oct 30 20:02:02.944188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:02.944155    6015 scope.go:122] "RemoveContainer" containerID="22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02"
Oct 30 20:02:02.945823 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:02.945777    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:02:02.945892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:02.945871    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:02:02.945936 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:02.945907    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:02:03.952415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:03.952317    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" event={"ID":"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a","Type":"ContainerStarted","Data":"bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f"}
Oct 30 20:02:03.953898 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:03.953875    6015 generic.go:356] "Generic (PLEG): container finished" podID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerID="e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c" exitCode=0
Oct 30 20:02:03.954010 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:03.953954    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" event={"ID":"bedde921-8b8e-485f-a7ce-ef571614f46c","Type":"ContainerDied","Data":"e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c"}
Oct 30 20:02:03.954339 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:03.954325    6015 scope.go:122] "RemoveContainer" containerID="e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c"
Oct 30 20:02:03.955742 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:03.955715    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:02:03.955823 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:03.955784    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:02:03.955865 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:03.955832    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:02:04.586831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:04.581222    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:02:04.586831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:04.584630    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:02:04.586831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:04.584703    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused"
Oct 30 20:02:04.964081 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:04.963982    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" event={"ID":"bedde921-8b8e-485f-a7ce-ef571614f46c","Type":"ContainerStarted","Data":"9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae"}
Oct 30 20:02:05.599832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:05.599048    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:02:05.599832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:05.599125    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused"
Oct 30 20:02:05.728164 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:05.724261    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:02:05.729259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:05.729220    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Oct 30 20:02:05.729408 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:05.729313    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Oct 30 20:02:05.997891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:05.997608    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:02:06.588840 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:06.582226    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:02:06.588840 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:06.582308    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused"
Oct 30 20:02:06.722255 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:06.722213    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Oct 30 20:02:06.722505 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:06.722482    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Oct 30 20:02:07.581835 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:07.579501    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:02:07.581835 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:07.579575    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused"
Oct 30 20:02:07.638066 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:07.638036    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:07.722830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:07.722321    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Oct 30 20:02:07.722830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:07.722400    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Oct 30 20:02:08.592833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:08.592615    6015 patch_prober.go:29] interesting pod/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused" start-of-body=
Oct 30 20:02:08.592833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:08.592674    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.103:15021/healthz/ready\": dial tcp 10.134.0.103:15021: connect: connection refused"
Oct 30 20:02:08.721898 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:08.721658    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Oct 30 20:02:08.721898 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:08.721715    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Oct 30 20:02:09.595835 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:09.594147    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:02:09.595835 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:09.595712    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:02:09.596728 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:09.596703    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:02:09.721365 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:09.721324    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused" start-of-body=
Oct 30 20:02:09.721595 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:09.721397    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.102:15021/healthz/ready\": dial tcp 10.134.0.102:15021: connect: connection refused"
Oct 30 20:02:10.727675 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:10.727633    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:02:10.729177 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:10.729153    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:02:11.382860 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:11.382823    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:11.893265 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:11.893221    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:12.971325 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:12.971292    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"]
Oct 30 20:02:12.971930 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:12.971911    6015 cpu_manager.go:414] "containerMap: removing container" podUID="b7e7ba59-738b-4209-89b9-f2f9710ace9c" containerName="payload-pre-processing"
Oct 30 20:02:12.971930 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:12.971927    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7e7ba59-738b-4209-89b9-f2f9710ace9c" containerName="payload-pre-processing"
Oct 30 20:02:12.972142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:12.972095    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7e7ba59-738b-4209-89b9-f2f9710ace9c" containerName="payload-pre-processing"
Oct 30 20:02:12.972142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:12.972110    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a52019d-6b02-43bc-a936-cc4ce3027259" containerName="cleanup"
Oct 30 20:02:12.974995 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:12.974974    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:02:13.071438 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.071395    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-ffe14b\""
Oct 30 20:02:13.071686 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.071502    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-ffe14b-dockercfg-b2stb\""
Oct 30 20:02:13.074480 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.074453    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"]
Oct 30 20:02:13.090173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.090142    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr5b7\" (UniqueName: \"kubernetes.io/projected/30aad67f-3694-41c0-a4b2-303665e009a8-kube-api-access-kr5b7\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v\" (UID: \"30aad67f-3694-41c0-a4b2-303665e009a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:02:13.090335 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.090207    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30aad67f-3694-41c0-a4b2-303665e009a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v\" (UID: \"30aad67f-3694-41c0-a4b2-303665e009a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:02:13.192220 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.192182    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr5b7\" (UniqueName: \"kubernetes.io/projected/30aad67f-3694-41c0-a4b2-303665e009a8-kube-api-access-kr5b7\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v\" (UID: \"30aad67f-3694-41c0-a4b2-303665e009a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:02:13.192421 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.192253    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30aad67f-3694-41c0-a4b2-303665e009a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v\" (UID: \"30aad67f-3694-41c0-a4b2-303665e009a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:02:13.193069 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.193048    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30aad67f-3694-41c0-a4b2-303665e009a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v\" (UID: \"30aad67f-3694-41c0-a4b2-303665e009a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:02:13.251755 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.251674    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr5b7\" (UniqueName: \"kubernetes.io/projected/30aad67f-3694-41c0-a4b2-303665e009a8-kube-api-access-kr5b7\") pod \"payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v\" (UID: \"30aad67f-3694-41c0-a4b2-303665e009a8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:02:13.288607 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.288569    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:02:13.670401 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.670368    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"]
Oct 30 20:02:13.676034 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:02:13.676006    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30aad67f_3694_41c0_a4b2_303665e009a8.slice/crio-e9ea69655fa726a24af03b8b3ded87246c85c9f5705f853d87c748dc71fc0637 WatchSource:0}: Error finding container e9ea69655fa726a24af03b8b3ded87246c85c9f5705f853d87c748dc71fc0637: Status 404 returned error can't find the container with id e9ea69655fa726a24af03b8b3ded87246c85c9f5705f853d87c748dc71fc0637
Oct 30 20:02:13.746276 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.746240    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"]
Oct 30 20:02:13.750583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.750561    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:02:13.806239 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.806179    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"]
Oct 30 20:02:13.914876 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.914837    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v269\" (UniqueName: \"kubernetes.io/projected/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-kube-api-access-8v269\") pod \"payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8\" (UID: \"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:02:13.915111 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:13.915076    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8\" (UID: \"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:02:14.016266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:14.016166    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8\" (UID: \"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:02:14.016659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:14.016330    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v269\" (UniqueName: \"kubernetes.io/projected/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-kube-api-access-8v269\") pod \"payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8\" (UID: \"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:02:14.016967 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:14.016947    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8\" (UID: \"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:02:14.075359 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:14.075318    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v269\" (UniqueName: \"kubernetes.io/projected/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-kube-api-access-8v269\") pod \"payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8\" (UID: \"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:02:14.076018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:14.075990    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v" event={"ID":"30aad67f-3694-41c0-a4b2-303665e009a8","Type":"ContainerStarted","Data":"e9ea69655fa726a24af03b8b3ded87246c85c9f5705f853d87c748dc71fc0637"}
Oct 30 20:02:14.365503 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:14.365462    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:02:14.744462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:14.744348    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"]
Oct 30 20:02:14.751380 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:02:14.751348    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7918fa4_3cee_40d5_bac7_bf1b08ea7a26.slice/crio-cc2e76d71e5e6cb8bac92ef4f33a4823434a2db6dd463f9937d53ec688a25500 WatchSource:0}: Error finding container cc2e76d71e5e6cb8bac92ef4f33a4823434a2db6dd463f9937d53ec688a25500: Status 404 returned error can't find the container with id cc2e76d71e5e6cb8bac92ef4f33a4823434a2db6dd463f9937d53ec688a25500
Oct 30 20:02:14.769033 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:14.768999    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:15.087968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:15.087930    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8" event={"ID":"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26","Type":"ContainerStarted","Data":"cc2e76d71e5e6cb8bac92ef4f33a4823434a2db6dd463f9937d53ec688a25500"}
Oct 30 20:02:17.125973 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:17.125933    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v" event={"ID":"30aad67f-3694-41c0-a4b2-303665e009a8","Type":"ContainerStarted","Data":"5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d"}
Oct 30 20:02:17.126721 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:17.126123    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:02:17.127853 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:17.127822    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8" event={"ID":"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26","Type":"ContainerStarted","Data":"791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2"}
Oct 30 20:02:17.127975 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:17.127877    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:02:17.240840 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:17.240769    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v" podStartSLOduration=2.853277635 podStartE2EDuration="5.240753046s" totalImagesPullingTime="2.387475411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:02:17.237422695 +0000 UTC m=+2199.780229962" watchObservedRunningTime="2026-10-30 20:02:17.240753046 +0000 UTC m=+2199.783560352"
Oct 30 20:02:17.349969 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:17.349899    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8" podStartSLOduration=2.908830981 podStartE2EDuration="4.349884172s" totalImagesPullingTime="1.441053191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:02:17.349218226 +0000 UTC m=+2199.892025496" watchObservedRunningTime="2026-10-30 20:02:17.349884172 +0000 UTC m=+2199.892691437"
Oct 30 20:02:21.416655 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:21.416619    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:21.588228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:21.588187    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:21.743351 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:21.743274    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:24.587685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:24.587648    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:24.742621 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:24.742576    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:26.744645 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:26.744608    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:28.137513 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:28.137482    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:02:28.138051 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:28.137748    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:02:28.217912 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:02:28.217849    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:02:31.900968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:31.900926    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:36.075602 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:36.075552    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:36.092970 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:36.092933    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"]
Oct 30 20:02:36.220278 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:36.220245    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"]
Oct 30 20:02:36.501448 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:36.501352    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:36.813567 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:36.813529    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:37.532838 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:37.532772    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:41.094199 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.094153    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp" podUID="10cce503-9143-49e1-b569-b23b99bd38b9" containerName="payload-processing" containerID="cri-o://8c46ceaa4d58243eb65eacf9f1c0aab9541399c0d3a2b854e822b99af1591c50" gracePeriod=25
Oct 30 20:02:41.220899 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.220838    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl" podUID="559e48c6-f016-49dc-a853-2443b81303f0" containerName="payload-pre-processing" containerID="cri-o://e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481" gracePeriod=25
Oct 30 20:02:41.312007 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.311876    6015 generic.go:356] "Generic (PLEG): container finished" podID="10cce503-9143-49e1-b569-b23b99bd38b9" containerID="8c46ceaa4d58243eb65eacf9f1c0aab9541399c0d3a2b854e822b99af1591c50" exitCode=0
Oct 30 20:02:41.312391 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.312310    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp" event={"ID":"10cce503-9143-49e1-b569-b23b99bd38b9","Type":"ContainerDied","Data":"8c46ceaa4d58243eb65eacf9f1c0aab9541399c0d3a2b854e822b99af1591c50"}
Oct 30 20:02:41.407044 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.407009    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:02:41.432432 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.432377    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/10cce503-9143-49e1-b569-b23b99bd38b9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10cce503-9143-49e1-b569-b23b99bd38b9-plugins-config-volume\") pod \"10cce503-9143-49e1-b569-b23b99bd38b9\" (UID: \"10cce503-9143-49e1-b569-b23b99bd38b9\") "
Oct 30 20:02:41.432616 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.432519    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10cce503-9143-49e1-b569-b23b99bd38b9-kube-api-access-fjh8p\" (UniqueName: \"kubernetes.io/projected/10cce503-9143-49e1-b569-b23b99bd38b9-kube-api-access-fjh8p\") pod \"10cce503-9143-49e1-b569-b23b99bd38b9\" (UID: \"10cce503-9143-49e1-b569-b23b99bd38b9\") "
Oct 30 20:02:41.433820 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.433772    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10cce503-9143-49e1-b569-b23b99bd38b9-plugins-config-volume" pod "10cce503-9143-49e1-b569-b23b99bd38b9" (UID: "10cce503-9143-49e1-b569-b23b99bd38b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:02:41.437018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.436986    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10cce503-9143-49e1-b569-b23b99bd38b9-kube-api-access-fjh8p" pod "10cce503-9143-49e1-b569-b23b99bd38b9" (UID: "10cce503-9143-49e1-b569-b23b99bd38b9"). InnerVolumeSpecName "kube-api-access-fjh8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:02:41.513544 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.513500    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:02:41.551834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.543722    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/559e48c6-f016-49dc-a853-2443b81303f0-kube-api-access-qch7s\" (UniqueName: \"kubernetes.io/projected/559e48c6-f016-49dc-a853-2443b81303f0-kube-api-access-qch7s\") pod \"559e48c6-f016-49dc-a853-2443b81303f0\" (UID: \"559e48c6-f016-49dc-a853-2443b81303f0\") "
Oct 30 20:02:41.551834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.544026    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/559e48c6-f016-49dc-a853-2443b81303f0-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/559e48c6-f016-49dc-a853-2443b81303f0-plugins-config-volume\") pod \"559e48c6-f016-49dc-a853-2443b81303f0\" (UID: \"559e48c6-f016-49dc-a853-2443b81303f0\") "
Oct 30 20:02:41.551834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.544593    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10cce503-9143-49e1-b569-b23b99bd38b9-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:02:41.551834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.544618    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjh8p\" (UniqueName: \"kubernetes.io/projected/10cce503-9143-49e1-b569-b23b99bd38b9-kube-api-access-fjh8p\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:02:41.581866 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.575645    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/559e48c6-f016-49dc-a853-2443b81303f0-plugins-config-volume" pod "559e48c6-f016-49dc-a853-2443b81303f0" (UID: "559e48c6-f016-49dc-a853-2443b81303f0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:02:41.608835 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.606053    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/559e48c6-f016-49dc-a853-2443b81303f0-kube-api-access-qch7s" pod "559e48c6-f016-49dc-a853-2443b81303f0" (UID: "559e48c6-f016-49dc-a853-2443b81303f0"). InnerVolumeSpecName "kube-api-access-qch7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:02:41.646189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.646158    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/559e48c6-f016-49dc-a853-2443b81303f0-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:02:41.646189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:41.646189    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qch7s\" (UniqueName: \"kubernetes.io/projected/559e48c6-f016-49dc-a853-2443b81303f0-kube-api-access-qch7s\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:02:42.319981 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.319946    6015 generic.go:356] "Generic (PLEG): container finished" podID="559e48c6-f016-49dc-a853-2443b81303f0" containerID="e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481" exitCode=0
Oct 30 20:02:42.320413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.319995    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"
Oct 30 20:02:42.320413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.320032    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl" event={"ID":"559e48c6-f016-49dc-a853-2443b81303f0","Type":"ContainerDied","Data":"e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481"}
Oct 30 20:02:42.320413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.320082    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl" event={"ID":"559e48c6-f016-49dc-a853-2443b81303f0","Type":"ContainerDied","Data":"44c67732ded254f8d260deaccbf04d344570e14b2d3bf03b85ee5e413cfb3eb6"}
Oct 30 20:02:42.320413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.320105    6015 scope.go:122] "RemoveContainer" containerID="e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481"
Oct 30 20:02:42.321726 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.321709    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"
Oct 30 20:02:42.321892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.321722    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp" event={"ID":"10cce503-9143-49e1-b569-b23b99bd38b9","Type":"ContainerDied","Data":"33183846b2d07ddfae4936d7a09f2e34845d38ec47a7bfceaf4ce36ef8efd50c"}
Oct 30 20:02:42.333254 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.333232    6015 scope.go:122] "RemoveContainer" containerID="e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481"
Oct 30 20:02:42.333645 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:02:42.333621    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481\": container with ID starting with e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481 not found: ID does not exist" containerID="e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481"
Oct 30 20:02:42.333769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.333650    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481"} err="failed to get container status \"e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481\": rpc error: code = NotFound desc = could not find container \"e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481\": container with ID starting with e5cf1610576b7b2b3051679488f72cf4def9e8bbb370997e91f35062ede64481 not found: ID does not exist"
Oct 30 20:02:42.333769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.333669    6015 scope.go:122] "RemoveContainer" containerID="8c46ceaa4d58243eb65eacf9f1c0aab9541399c0d3a2b854e822b99af1591c50"
Oct 30 20:02:42.493699 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.493588    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"]
Oct 30 20:02:42.497185 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.497147    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-598876d6c8-n5frp"]
Oct 30 20:02:42.602695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.602657    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"]
Oct 30 20:02:42.606983 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.606951    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-8b0edc-8666f8466c-trgjl"]
Oct 30 20:02:42.799404 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:42.799373    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:43.601213 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:43.601179    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10cce503-9143-49e1-b569-b23b99bd38b9" path="/var/lib/kubelet/pods/10cce503-9143-49e1-b569-b23b99bd38b9/volumes"
Oct 30 20:02:43.601731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:43.601715    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="559e48c6-f016-49dc-a853-2443b81303f0" path="/var/lib/kubelet/pods/559e48c6-f016-49dc-a853-2443b81303f0/volumes"
Oct 30 20:02:47.952506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:47.952467    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:51.468585 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:51.468541    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:51.841315 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:51.841280    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:52.393940 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:52.393907    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:52.397668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:52.397642    6015 generic.go:356] "Generic (PLEG): container finished" podID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerID="034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a" exitCode=0
Oct 30 20:02:52.397837 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:52.397684    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" event={"ID":"96a6c8f6-c1b1-4622-a9e3-86766dc96e97","Type":"ContainerDied","Data":"034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a"}
Oct 30 20:02:52.398140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:52.398126    6015 scope.go:122] "RemoveContainer" containerID="034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a"
Oct 30 20:02:52.399840 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:52.399787    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:02:52.399929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:52.399879    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:02:52.399929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:52.399913    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:02:52.555581 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:52.555463    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:53.390015 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:53.389915    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:02:53.397515 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:53.397480    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:53.406987 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:53.406945    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" event={"ID":"96a6c8f6-c1b1-4622-a9e3-86766dc96e97","Type":"ContainerStarted","Data":"ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3"}
Oct 30 20:02:53.614932 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:53.614895    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:02:53.615558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:53.615523    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused"
Oct 30 20:02:53.655738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:53.631682    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:02:54.610746 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:54.610713    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:02:54.610953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:54.610772    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused"
Oct 30 20:02:54.660884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:54.660848    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:55.115629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:55.115589    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"]
Oct 30 20:02:55.115863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:55.115832    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4" podUID="cf05960d-4801-4d8f-9479-7110f0266b2f" containerName="istio-proxy" containerID="cri-o://ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a" gracePeriod=30
Oct 30 20:02:55.610871 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:55.610782    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:02:55.611055 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:55.610890    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused"
Oct 30 20:02:56.610685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:56.610642    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:02:56.611236 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:56.610700    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused"
Oct 30 20:02:57.610520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:57.610485    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:02:57.610724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:57.610540    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused"
Oct 30 20:02:58.229505 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:02:58.229468    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:02:58.610996 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:58.610942    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused" start-of-body=
Oct 30 20:02:58.611412 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:58.611021    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.104:15021/healthz/ready\": dial tcp 10.134.0.104:15021: connect: connection refused"
Oct 30 20:02:58.624877 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:58.624843    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:02:59.616103 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:59.616069    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:02:59.616548 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:59.616407    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:02:59.617273 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:02:59.617252    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:03:00.401696 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.401631    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 20:03:00.458787 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.458750    6015 generic.go:356] "Generic (PLEG): container finished" podID="cf05960d-4801-4d8f-9479-7110f0266b2f" containerID="ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a" exitCode=0
Oct 30 20:03:00.458994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.458835    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"
Oct 30 20:03:00.458994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.458833    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4" event={"ID":"cf05960d-4801-4d8f-9479-7110f0266b2f","Type":"ContainerDied","Data":"ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a"}
Oct 30 20:03:00.458994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.458963    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4" event={"ID":"cf05960d-4801-4d8f-9479-7110f0266b2f","Type":"ContainerDied","Data":"8e858b4a49c2e6e49b8025200ff2d176a0b86f6e19dc66b44154614dfaa7bedc"}
Oct 30 20:03:00.458994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.458987    6015 scope.go:122] "RemoveContainer" containerID="ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a"
Oct 30 20:03:00.469476 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.469449    6015 scope.go:122] "RemoveContainer" containerID="ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a"
Oct 30 20:03:00.469796 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:03:00.469776    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a\": container with ID starting with ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a not found: ID does not exist" containerID="ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a"
Oct 30 20:03:00.469890 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.469839    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a"} err="failed to get container status \"ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a\": rpc error: code = NotFound desc = could not find container \"ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a\": container with ID starting with ba2fad1dd87edbed07fef53930e8ee2bca4f62f9591b524f079af47486e9b81a not found: ID does not exist"
Oct 30 20:03:00.486360 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486329    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-kube-api-access-7szwv\" (UniqueName: \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-kube-api-access-7szwv\") pod \"cf05960d-4801-4d8f-9479-7110f0266b2f\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") "
Oct 30 20:03:00.486520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486380    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-data\") pod \"cf05960d-4801-4d8f-9479-7110f0266b2f\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") "
Oct 30 20:03:00.486562 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486529    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-socket\") pod \"cf05960d-4801-4d8f-9479-7110f0266b2f\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") "
Oct 30 20:03:00.486562 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486549    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-token\" (UniqueName: \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-token\") pod \"cf05960d-4801-4d8f-9479-7110f0266b2f\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") "
Oct 30 20:03:00.486644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486571    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-podinfo\") pod \"cf05960d-4801-4d8f-9479-7110f0266b2f\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") "
Oct 30 20:03:00.486644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486589    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-certs\") pod \"cf05960d-4801-4d8f-9479-7110f0266b2f\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") "
Oct 30 20:03:00.486644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486628    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-credential-socket\") pod \"cf05960d-4801-4d8f-9479-7110f0266b2f\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") "
Oct 30 20:03:00.486798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486684    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-envoy\") pod \"cf05960d-4801-4d8f-9479-7110f0266b2f\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") "
Oct 30 20:03:00.486798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486693    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-data" pod "cf05960d-4801-4d8f-9479-7110f0266b2f" (UID: "cf05960d-4801-4d8f-9479-7110f0266b2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:03:00.486798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486748    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf05960d-4801-4d8f-9479-7110f0266b2f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf05960d-4801-4d8f-9479-7110f0266b2f-istiod-ca-cert\") pod \"cf05960d-4801-4d8f-9479-7110f0266b2f\" (UID: \"cf05960d-4801-4d8f-9479-7110f0266b2f\") "
Oct 30 20:03:00.487009 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486886    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-socket" pod "cf05960d-4801-4d8f-9479-7110f0266b2f" (UID: "cf05960d-4801-4d8f-9479-7110f0266b2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:03:00.487009 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486941    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-credential-socket" pod "cf05960d-4801-4d8f-9479-7110f0266b2f" (UID: "cf05960d-4801-4d8f-9479-7110f0266b2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:03:00.487009 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.486978    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-certs" pod "cf05960d-4801-4d8f-9479-7110f0266b2f" (UID: "cf05960d-4801-4d8f-9479-7110f0266b2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:03:00.487338 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.487250    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf05960d-4801-4d8f-9479-7110f0266b2f-istiod-ca-cert" pod "cf05960d-4801-4d8f-9479-7110f0266b2f" (UID: "cf05960d-4801-4d8f-9479-7110f0266b2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:03:00.487589 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.487486    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf05960d-4801-4d8f-9479-7110f0266b2f-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:03:00.487589 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.487511    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:03:00.487589 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.487525    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:03:00.487589 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.487539    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:03:00.487589 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.487553    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:03:00.489494 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.489468    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-envoy" pod "cf05960d-4801-4d8f-9479-7110f0266b2f" (UID: "cf05960d-4801-4d8f-9479-7110f0266b2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:03:00.489552 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.489491    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-token" pod "cf05960d-4801-4d8f-9479-7110f0266b2f" (UID: "cf05960d-4801-4d8f-9479-7110f0266b2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:03:00.489610 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.489596    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-kube-api-access-7szwv" pod "cf05960d-4801-4d8f-9479-7110f0266b2f" (UID: "cf05960d-4801-4d8f-9479-7110f0266b2f"). InnerVolumeSpecName "kube-api-access-7szwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:03:00.489886 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.489869    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-podinfo" pod "cf05960d-4801-4d8f-9479-7110f0266b2f" (UID: "cf05960d-4801-4d8f-9479-7110f0266b2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:03:00.588539 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.588507    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:03:00.588539 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.588536    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:03:00.588539 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.588547    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf05960d-4801-4d8f-9479-7110f0266b2f-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:03:00.588887 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.588564    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7szwv\" (UniqueName: \"kubernetes.io/projected/cf05960d-4801-4d8f-9479-7110f0266b2f-kube-api-access-7szwv\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:03:00.612122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.612086    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:00.885524 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.885487    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"]
Oct 30 20:03:00.932514 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:00.932475    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-7p7l4"]
Oct 30 20:03:01.480885 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:01.480847    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:01.586487 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:01.586448    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf05960d-4801-4d8f-9479-7110f0266b2f" path="/var/lib/kubelet/pods/cf05960d-4801-4d8f-9479-7110f0266b2f/volumes"
Oct 30 20:03:02.206908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:02.206869    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:02.412500 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:02.412460    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:04.022146 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:04.022103    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:04.192203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:04.192155    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:04.347959 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:04.347924    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:08.052001 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:08.051962    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:08.294858 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:08.294800    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:08.464140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:08.464042    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:09.912468 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:09.912431    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:11.385145 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.385102    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:11.565644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.565612    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:11.984886 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.984851    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"]
Oct 30 20:03:11.986843 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.986787    6015 cpu_manager.go:414] "containerMap: removing container" podUID="559e48c6-f016-49dc-a853-2443b81303f0" containerName="payload-pre-processing"
Oct 30 20:03:11.987073 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.987055    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="559e48c6-f016-49dc-a853-2443b81303f0" containerName="payload-pre-processing"
Oct 30 20:03:11.987213 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.987201    6015 cpu_manager.go:414] "containerMap: removing container" podUID="10cce503-9143-49e1-b569-b23b99bd38b9" containerName="payload-processing"
Oct 30 20:03:11.987340 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.987327    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10cce503-9143-49e1-b569-b23b99bd38b9" containerName="payload-processing"
Oct 30 20:03:11.987475 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.987464    6015 cpu_manager.go:414] "containerMap: removing container" podUID="cf05960d-4801-4d8f-9479-7110f0266b2f" containerName="istio-proxy"
Oct 30 20:03:11.987573 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.987548    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf05960d-4801-4d8f-9479-7110f0266b2f" containerName="istio-proxy"
Oct 30 20:03:11.987880 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.987865    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="559e48c6-f016-49dc-a853-2443b81303f0" containerName="payload-pre-processing"
Oct 30 20:03:11.987986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.987976    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="10cce503-9143-49e1-b569-b23b99bd38b9" containerName="payload-processing"
Oct 30 20:03:11.988072 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.988063    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf05960d-4801-4d8f-9479-7110f0266b2f" containerName="istio-proxy"
Oct 30 20:03:11.993827 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:11.993781    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:03:12.021199 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.021167    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"]
Oct 30 20:03:12.065063 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.065018    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-c60685\""
Oct 30 20:03:12.065063 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.065047    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-c60685-dockercfg-dsb8d\""
Oct 30 20:03:12.082587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.082546    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zktmj\" (UniqueName: \"kubernetes.io/projected/5242be24-7716-4dec-97bb-3318e84d339d-kube-api-access-zktmj\") pod \"payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x\" (UID: \"5242be24-7716-4dec-97bb-3318e84d339d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:03:12.082761 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.082604    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5242be24-7716-4dec-97bb-3318e84d339d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x\" (UID: \"5242be24-7716-4dec-97bb-3318e84d339d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:03:12.184867 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.184801    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zktmj\" (UniqueName: \"kubernetes.io/projected/5242be24-7716-4dec-97bb-3318e84d339d-kube-api-access-zktmj\") pod \"payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x\" (UID: \"5242be24-7716-4dec-97bb-3318e84d339d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:03:12.185088 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.184881    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5242be24-7716-4dec-97bb-3318e84d339d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x\" (UID: \"5242be24-7716-4dec-97bb-3318e84d339d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:03:12.185623 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.185596    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5242be24-7716-4dec-97bb-3318e84d339d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x\" (UID: \"5242be24-7716-4dec-97bb-3318e84d339d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:03:12.243667 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.243590    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zktmj\" (UniqueName: \"kubernetes.io/projected/5242be24-7716-4dec-97bb-3318e84d339d-kube-api-access-zktmj\") pod \"payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x\" (UID: \"5242be24-7716-4dec-97bb-3318e84d339d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:03:12.309867 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.309823    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:03:12.421099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.420984    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:12.647891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.647849    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:12.688173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:12.688139    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"]
Oct 30 20:03:12.694460 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:03:12.694428    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5242be24_7716_4dec_97bb_3318e84d339d.slice/crio-7750117ee09a237c58e7bda45a4674bbbabad60083cbd3eeb0bbe43bc915b432 WatchSource:0}: Error finding container 7750117ee09a237c58e7bda45a4674bbbabad60083cbd3eeb0bbe43bc915b432: Status 404 returned error can't find the container with id 7750117ee09a237c58e7bda45a4674bbbabad60083cbd3eeb0bbe43bc915b432
Oct 30 20:03:13.587750 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:13.587706    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x" event={"ID":"5242be24-7716-4dec-97bb-3318e84d339d","Type":"ContainerStarted","Data":"642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a"}
Oct 30 20:03:13.588287 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:13.587780    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:03:13.588287 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:13.587824    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x" event={"ID":"5242be24-7716-4dec-97bb-3318e84d339d","Type":"ContainerStarted","Data":"7750117ee09a237c58e7bda45a4674bbbabad60083cbd3eeb0bbe43bc915b432"}
Oct 30 20:03:13.697528 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:13.697466    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x" podStartSLOduration=2.6974502449999997 podStartE2EDuration="2.697450245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:13.69566475 +0000 UTC m=+2256.238472015" watchObservedRunningTime="2026-10-30 20:03:13.697450245 +0000 UTC m=+2256.240257509"
Oct 30 20:03:15.132601 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:15.132563    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:17.893404 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:17.893313    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:18.800391 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:18.800356    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:19.328823 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.328779    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"]
Oct 30 20:03:19.334049 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.334022    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.389885 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.389797    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-credential-socket\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.390411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.390384    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/931bf764-99e5-43a7-af49-a994ac30a68a-istiod-ca-cert\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.390593 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.390577    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-socket\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.390714 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.390697    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-envoy\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.390881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.390867    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/931bf764-99e5-43a7-af49-a994ac30a68a-istio-podinfo\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.391076 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.391060    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rg8f\" (UniqueName: \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-kube-api-access-2rg8f\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.450327 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.450281    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-istio-token\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.450961 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.450739    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-certs\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.458010 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.457931    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-data\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.458718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.454177    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-f700fe-openshift-default-dockercfg-9lcvm\""
Oct 30 20:03:19.458718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.453357    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:19.460411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.460385    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"]
Oct 30 20:03:19.559704 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.559672    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-credential-socket\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.559952 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.559709    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/931bf764-99e5-43a7-af49-a994ac30a68a-istiod-ca-cert\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.559952 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.559750    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-socket\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.559952 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.559774    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-envoy\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.560153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.559997    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/931bf764-99e5-43a7-af49-a994ac30a68a-istio-podinfo\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.560209 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.560195    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rg8f\" (UniqueName: \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-kube-api-access-2rg8f\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.560266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.560229    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-credential-socket\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.560321 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.560283    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-istio-token\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.560321 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.560289    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-socket\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.560321 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.560314    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-certs\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.560511 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.560373    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-data\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.560630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.560609    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/931bf764-99e5-43a7-af49-a994ac30a68a-istiod-ca-cert\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.560689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.560631    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-certs\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.560725 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.560699    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-data\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.562963 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.562918    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-envoy\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.565568 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.565540    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/931bf764-99e5-43a7-af49-a994ac30a68a-istio-podinfo\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.618999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.618917    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rg8f\" (UniqueName: \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-kube-api-access-2rg8f\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.619142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.619017    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-istio-token\") pod \"e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") " pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.649419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.649388    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:19.886979 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:19.886880    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:20.087060 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:20.087016    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:20.094235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:20.094192    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"]
Oct 30 20:03:20.099284 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:03:20.099256    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931bf764_99e5_43a7_af49_a994ac30a68a.slice/crio-24b4f58999d6483edfb37b2adabf4c1bfd6ee419da1bbd49b3970fc21d541354 WatchSource:0}: Error finding container 24b4f58999d6483edfb37b2adabf4c1bfd6ee419da1bbd49b3970fc21d541354: Status 404 returned error can't find the container with id 24b4f58999d6483edfb37b2adabf4c1bfd6ee419da1bbd49b3970fc21d541354
Oct 30 20:03:20.101986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:20.101948    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:03:20.102103 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:20.102041    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:03:20.102103 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:20.102085    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:03:20.246627 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:20.246583    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:20.637462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:20.637426    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" event={"ID":"931bf764-99e5-43a7-af49-a994ac30a68a","Type":"ContainerStarted","Data":"0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41"}
Oct 30 20:03:20.637974 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:20.637487    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" event={"ID":"931bf764-99e5-43a7-af49-a994ac30a68a","Type":"ContainerStarted","Data":"24b4f58999d6483edfb37b2adabf4c1bfd6ee419da1bbd49b3970fc21d541354"}
Oct 30 20:03:20.649793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:20.649763    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:20.650956 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:20.650925    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:20.754906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:20.754845    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" podStartSLOduration=1.754830026 podStartE2EDuration="1.754830026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:20.75317963 +0000 UTC m=+2263.295986907" watchObservedRunningTime="2026-10-30 20:03:20.754830026 +0000 UTC m=+2263.297637285"
Oct 30 20:03:21.656216 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:21.656184    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:22.653080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:22.653047    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:22.654190 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:22.654171    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:03:23.605792 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:23.605745    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:23.765507 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:23.765470    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:23.941047 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:23.940935    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:24.595682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:24.595649    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:03:26.725786 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:26.725743    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:26.944356 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:26.944313    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:27.124307 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.124276    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:27.490274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.490184    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"]
Oct 30 20:03:27.495337 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.495305    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:03:27.606839 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.606787    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-f700fe\""
Oct 30 20:03:27.608460 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.607166    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-f700fe-dockercfg-6c5hf\""
Oct 30 20:03:27.611920 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.611888    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"]
Oct 30 20:03:27.627214 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.627180    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb24b90e-8a67-4504-95dd-1af78f642318-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf\" (UID: \"fb24b90e-8a67-4504-95dd-1af78f642318\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:03:27.627433 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.627413    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjk94\" (UniqueName: \"kubernetes.io/projected/fb24b90e-8a67-4504-95dd-1af78f642318-kube-api-access-bjk94\") pod \"payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf\" (UID: \"fb24b90e-8a67-4504-95dd-1af78f642318\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:03:27.729070 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.729026    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjk94\" (UniqueName: \"kubernetes.io/projected/fb24b90e-8a67-4504-95dd-1af78f642318-kube-api-access-bjk94\") pod \"payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf\" (UID: \"fb24b90e-8a67-4504-95dd-1af78f642318\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:03:27.729625 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.729157    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb24b90e-8a67-4504-95dd-1af78f642318-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf\" (UID: \"fb24b90e-8a67-4504-95dd-1af78f642318\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:03:27.730168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.730144    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb24b90e-8a67-4504-95dd-1af78f642318-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf\" (UID: \"fb24b90e-8a67-4504-95dd-1af78f642318\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:03:27.788005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.787925    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjk94\" (UniqueName: \"kubernetes.io/projected/fb24b90e-8a67-4504-95dd-1af78f642318-kube-api-access-bjk94\") pod \"payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf\" (UID: \"fb24b90e-8a67-4504-95dd-1af78f642318\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:03:27.862029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:27.861989    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:03:28.217649 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:03:28.217611    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:03:28.250308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:28.250271    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"]
Oct 30 20:03:28.256619 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:03:28.256586    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb24b90e_8a67_4504_95dd_1af78f642318.slice/crio-c3adbc6d5df5362ae853ee6d80fee2d58a7993016dc57417a06a5ad9adaa41d8 WatchSource:0}: Error finding container c3adbc6d5df5362ae853ee6d80fee2d58a7993016dc57417a06a5ad9adaa41d8: Status 404 returned error can't find the container with id c3adbc6d5df5362ae853ee6d80fee2d58a7993016dc57417a06a5ad9adaa41d8
Oct 30 20:03:28.292089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:28.292050    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:28.696769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:28.696729    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf" event={"ID":"fb24b90e-8a67-4504-95dd-1af78f642318","Type":"ContainerStarted","Data":"7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13"}
Oct 30 20:03:28.697025 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:28.696792    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf" event={"ID":"fb24b90e-8a67-4504-95dd-1af78f642318","Type":"ContainerStarted","Data":"c3adbc6d5df5362ae853ee6d80fee2d58a7993016dc57417a06a5ad9adaa41d8"}
Oct 30 20:03:28.697025 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:28.696964    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:03:28.807780 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:28.807730    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf" podStartSLOduration=1.807715511 podStartE2EDuration="1.807715511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:28.806763746 +0000 UTC m=+2271.349571026" watchObservedRunningTime="2026-10-30 20:03:28.807715511 +0000 UTC m=+2271.350522800"
Oct 30 20:03:35.210282 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:35.210244    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:39.708623 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:39.708594    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:03:41.954363 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:41.954329    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:47.325352 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:47.325304    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:48.358684 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:48.358645    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:49.125395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:49.125330    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:49.338320 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:49.338286    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:51.422574 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:51.422540    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:51.838876 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:51.838840    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:52.045021 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:52.044980    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:53.810424 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:53.810381    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"]
Oct 30 20:03:53.816576 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:53.816542    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:03:53.870218 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:53.870174    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"]
Oct 30 20:03:53.908955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:53.908912    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9sbp\" (UniqueName: \"kubernetes.io/projected/e76515be-1a41-4328-860f-9e6ef65cb26e-kube-api-access-b9sbp\") pod \"payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr\" (UID: \"e76515be-1a41-4328-860f-9e6ef65cb26e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:03:53.909169 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:53.909128    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e76515be-1a41-4328-860f-9e6ef65cb26e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr\" (UID: \"e76515be-1a41-4328-860f-9e6ef65cb26e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:03:53.912786 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:53.912760    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-8b0edc\""
Oct 30 20:03:53.913001 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:53.912866    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-8b0edc-dockercfg-7wncr\""
Oct 30 20:03:54.010659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:54.010613    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e76515be-1a41-4328-860f-9e6ef65cb26e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr\" (UID: \"e76515be-1a41-4328-860f-9e6ef65cb26e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:03:54.010889 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:54.010744    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9sbp\" (UniqueName: \"kubernetes.io/projected/e76515be-1a41-4328-860f-9e6ef65cb26e-kube-api-access-b9sbp\") pod \"payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr\" (UID: \"e76515be-1a41-4328-860f-9e6ef65cb26e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:03:54.011449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:54.011428    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e76515be-1a41-4328-860f-9e6ef65cb26e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr\" (UID: \"e76515be-1a41-4328-860f-9e6ef65cb26e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:03:54.069099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:54.069021    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9sbp\" (UniqueName: \"kubernetes.io/projected/e76515be-1a41-4328-860f-9e6ef65cb26e-kube-api-access-b9sbp\") pod \"payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr\" (UID: \"e76515be-1a41-4328-860f-9e6ef65cb26e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:03:54.131405 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:54.131361    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:03:54.512134 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:54.512046    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"]
Oct 30 20:03:54.518546 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:03:54.518509    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76515be_1a41_4328_860f_9e6ef65cb26e.slice/crio-fe2ba09487977c218c5fbae922788541215546203cec69ea9afdb8a3b0ff608a WatchSource:0}: Error finding container fe2ba09487977c218c5fbae922788541215546203cec69ea9afdb8a3b0ff608a: Status 404 returned error can't find the container with id fe2ba09487977c218c5fbae922788541215546203cec69ea9afdb8a3b0ff608a
Oct 30 20:03:54.866880 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:54.866844    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr" event={"ID":"e76515be-1a41-4328-860f-9e6ef65cb26e","Type":"ContainerStarted","Data":"2b6fa42fb6c1417963465dc691d593b0fff8c72ff0713183ba721acbcb701230"}
Oct 30 20:03:54.867348 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:54.866901    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr" event={"ID":"e76515be-1a41-4328-860f-9e6ef65cb26e","Type":"ContainerStarted","Data":"fe2ba09487977c218c5fbae922788541215546203cec69ea9afdb8a3b0ff608a"}
Oct 30 20:03:54.867348 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:54.866958    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:03:54.990559 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:54.990487    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr" podStartSLOduration=1.990458793 podStartE2EDuration="1.990458793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:03:54.977516697 +0000 UTC m=+2297.520323975" watchObservedRunningTime="2026-10-30 20:03:54.990458793 +0000 UTC m=+2297.533266059"
Oct 30 20:03:55.074308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:55.074277    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:03:57.425974 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:57.425932    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"]
Oct 30 20:03:57.426439 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:57.426192    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy" containerID="cri-o://f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd" gracePeriod=30
Oct 30 20:03:57.473707 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:57.473665    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"]
Oct 30 20:03:57.474004 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:57.473968    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy" containerID="cri-o://4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3" gracePeriod=30
Oct 30 20:03:57.476897 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:57.476865    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"]
Oct 30 20:03:57.477140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:57.477112    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy" containerID="cri-o://56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8" gracePeriod=30
Oct 30 20:03:58.215671 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:03:58.215633    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:03:58.765910 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:58.765866    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-859kr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:03:58.766345 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:03:58.765927    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:04:00.086353 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:00.086313    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:02.791552 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.791524    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 20:04:02.828890 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.828863    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-podinfo\") pod \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") "
Oct 30 20:04:02.829056 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.828943    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-envoy\") pod \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") "
Oct 30 20:04:02.829056 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.829022    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-socket\") pod \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") "
Oct 30 20:04:02.829183 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.829069    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-data\") pod \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") "
Oct 30 20:04:02.829183 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.829113    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-credential-socket\") pod \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") "
Oct 30 20:04:02.829289 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.829198    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-certs\") pod \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") "
Oct 30 20:04:02.829289 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.829260    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istiod-ca-cert\") pod \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") "
Oct 30 20:04:02.829393 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.829291    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-token\" (UniqueName: \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-token\") pod \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") "
Oct 30 20:04:02.829393 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.829330    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-kube-api-access-vdsl4\" (UniqueName: \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-kube-api-access-vdsl4\") pod \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\" (UID: \"1390fa61-d871-4ad0-ab4b-0b581a7cb08f\") "
Oct 30 20:04:02.829393 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.829343    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-socket" pod "1390fa61-d871-4ad0-ab4b-0b581a7cb08f" (UID: "1390fa61-d871-4ad0-ab4b-0b581a7cb08f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.829611 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.829576    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-certs" pod "1390fa61-d871-4ad0-ab4b-0b581a7cb08f" (UID: "1390fa61-d871-4ad0-ab4b-0b581a7cb08f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.829994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.829976    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.830051 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.830000    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.830086 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.830060    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-data" pod "1390fa61-d871-4ad0-ab4b-0b581a7cb08f" (UID: "1390fa61-d871-4ad0-ab4b-0b581a7cb08f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.830990 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.830885    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istiod-ca-cert" pod "1390fa61-d871-4ad0-ab4b-0b581a7cb08f" (UID: "1390fa61-d871-4ad0-ab4b-0b581a7cb08f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:04:02.830990 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.830964    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-credential-socket" pod "1390fa61-d871-4ad0-ab4b-0b581a7cb08f" (UID: "1390fa61-d871-4ad0-ab4b-0b581a7cb08f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.831563 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.831540    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-envoy" pod "1390fa61-d871-4ad0-ab4b-0b581a7cb08f" (UID: "1390fa61-d871-4ad0-ab4b-0b581a7cb08f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.831669 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.831653    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-podinfo" pod "1390fa61-d871-4ad0-ab4b-0b581a7cb08f" (UID: "1390fa61-d871-4ad0-ab4b-0b581a7cb08f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:04:02.832782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.832756    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-token" pod "1390fa61-d871-4ad0-ab4b-0b581a7cb08f" (UID: "1390fa61-d871-4ad0-ab4b-0b581a7cb08f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:04:02.833024 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.832999    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-kube-api-access-vdsl4" pod "1390fa61-d871-4ad0-ab4b-0b581a7cb08f" (UID: "1390fa61-d871-4ad0-ab4b-0b581a7cb08f"). InnerVolumeSpecName "kube-api-access-vdsl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:04:02.838438 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.838415    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 20:04:02.841893 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.841876    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 20:04:02.923000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.922963    6015 generic.go:356] "Generic (PLEG): container finished" podID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerID="f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd" exitCode=0
Oct 30 20:04:02.923181 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.923016    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"
Oct 30 20:04:02.923181 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.923039    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" event={"ID":"1390fa61-d871-4ad0-ab4b-0b581a7cb08f","Type":"ContainerDied","Data":"f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd"}
Oct 30 20:04:02.923181 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.923103    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt" event={"ID":"1390fa61-d871-4ad0-ab4b-0b581a7cb08f","Type":"ContainerDied","Data":"1e9f212ea385c436aa4d8129f791b49f202a27d6ed30c13d5ceb1f702f0851a7"}
Oct 30 20:04:02.923181 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.923127    6015 scope.go:122] "RemoveContainer" containerID="f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd"
Oct 30 20:04:02.924770 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.924746    6015 generic.go:356] "Generic (PLEG): container finished" podID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerID="4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3" exitCode=0
Oct 30 20:04:02.924938 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.924822    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"
Oct 30 20:04:02.924938 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.924927    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" event={"ID":"33e74325-ee0f-43be-b4ef-c7ddf3778d43","Type":"ContainerDied","Data":"4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3"}
Oct 30 20:04:02.925073 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.924979    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8" event={"ID":"33e74325-ee0f-43be-b4ef-c7ddf3778d43","Type":"ContainerDied","Data":"71571ffac554e4d8bc2f1df7733b1fed44d832444c89cb2d1809cb2028eec898"}
Oct 30 20:04:02.926478 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.926446    6015 generic.go:356] "Generic (PLEG): container finished" podID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerID="56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8" exitCode=0
Oct 30 20:04:02.926583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.926491    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" event={"ID":"1ab8f161-e5ca-4218-917c-8fb515ef3099","Type":"ContainerDied","Data":"56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8"}
Oct 30 20:04:02.926583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.926549    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr" event={"ID":"1ab8f161-e5ca-4218-917c-8fb515ef3099","Type":"ContainerDied","Data":"5b723ef94fdc6c20af94811860f83ff13dc050594af363d7a86cc9740dd6c641"}
Oct 30 20:04:02.926583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.926503    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"
Oct 30 20:04:02.931191 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931167    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-envoy\") pod \"1ab8f161-e5ca-4218-917c-8fb515ef3099\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") "
Oct 30 20:04:02.931314 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931210    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-data\") pod \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") "
Oct 30 20:04:02.931314 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931267    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-socket\") pod \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") "
Oct 30 20:04:02.931616 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931427    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-socket\") pod \"1ab8f161-e5ca-4218-917c-8fb515ef3099\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") "
Oct 30 20:04:02.931616 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931474    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-kube-api-access-r5kzz\" (UniqueName: \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-kube-api-access-r5kzz\") pod \"1ab8f161-e5ca-4218-917c-8fb515ef3099\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") "
Oct 30 20:04:02.931616 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931519    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-data" pod "33e74325-ee0f-43be-b4ef-c7ddf3778d43" (UID: "33e74325-ee0f-43be-b4ef-c7ddf3778d43"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.931616 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931533    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istiod-ca-cert\") pod \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") "
Oct 30 20:04:02.931616 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931557    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-socket" pod "33e74325-ee0f-43be-b4ef-c7ddf3778d43" (UID: "33e74325-ee0f-43be-b4ef-c7ddf3778d43"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.931616 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931563    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-certs\") pod \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") "
Oct 30 20:04:02.931958 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931631    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-kube-api-access-rm6qd\" (UniqueName: \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-kube-api-access-rm6qd\") pod \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") "
Oct 30 20:04:02.931958 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931702    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-token\" (UniqueName: \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-token\") pod \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") "
Oct 30 20:04:02.931958 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931713    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-socket" pod "1ab8f161-e5ca-4218-917c-8fb515ef3099" (UID: "1ab8f161-e5ca-4218-917c-8fb515ef3099"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.931958 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931750    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-credential-socket\") pod \"1ab8f161-e5ca-4218-917c-8fb515ef3099\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") "
Oct 30 20:04:02.931958 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931786    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-credential-socket\") pod \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") "
Oct 30 20:04:02.931958 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931841    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-certs" pod "33e74325-ee0f-43be-b4ef-c7ddf3778d43" (UID: "33e74325-ee0f-43be-b4ef-c7ddf3778d43"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.931958 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931874    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-envoy\") pod \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") "
Oct 30 20:04:02.931958 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931911    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-podinfo\") pod \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\" (UID: \"33e74325-ee0f-43be-b4ef-c7ddf3778d43\") "
Oct 30 20:04:02.931958 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.931940    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-data\") pod \"1ab8f161-e5ca-4218-917c-8fb515ef3099\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") "
Oct 30 20:04:02.932718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.932009    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-token\" (UniqueName: \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-token\") pod \"1ab8f161-e5ca-4218-917c-8fb515ef3099\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") "
Oct 30 20:04:02.932718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.932065    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-podinfo\") pod \"1ab8f161-e5ca-4218-917c-8fb515ef3099\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") "
Oct 30 20:04:02.932718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.932124    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ab8f161-e5ca-4218-917c-8fb515ef3099-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ab8f161-e5ca-4218-917c-8fb515ef3099-istiod-ca-cert\") pod \"1ab8f161-e5ca-4218-917c-8fb515ef3099\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") "
Oct 30 20:04:02.932718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.932127    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-credential-socket" pod "33e74325-ee0f-43be-b4ef-c7ddf3778d43" (UID: "33e74325-ee0f-43be-b4ef-c7ddf3778d43"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.932718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.932296    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-certs\") pod \"1ab8f161-e5ca-4218-917c-8fb515ef3099\" (UID: \"1ab8f161-e5ca-4218-917c-8fb515ef3099\") "
Oct 30 20:04:02.932718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.932339    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-credential-socket" pod "1ab8f161-e5ca-4218-917c-8fb515ef3099" (UID: "1ab8f161-e5ca-4218-917c-8fb515ef3099"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.932718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.932367    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istiod-ca-cert" pod "33e74325-ee0f-43be-b4ef-c7ddf3778d43" (UID: "33e74325-ee0f-43be-b4ef-c7ddf3778d43"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:04:02.932718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.932542    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-data" pod "1ab8f161-e5ca-4218-917c-8fb515ef3099" (UID: "1ab8f161-e5ca-4218-917c-8fb515ef3099"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.932984    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933005    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933020    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933039    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933052    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933067    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933081    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933093    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933106    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933120    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933137    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933151    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.933168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933166    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdsl4\" (UniqueName: \"kubernetes.io/projected/1390fa61-d871-4ad0-ab4b-0b581a7cb08f-kube-api-access-vdsl4\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.934030 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933178    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.934030 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.933206    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:02.934442 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.934410    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-envoy" pod "1ab8f161-e5ca-4218-917c-8fb515ef3099" (UID: "1ab8f161-e5ca-4218-917c-8fb515ef3099"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.934690 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.934665    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-token" pod "33e74325-ee0f-43be-b4ef-c7ddf3778d43" (UID: "33e74325-ee0f-43be-b4ef-c7ddf3778d43"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:04:02.934980 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.934955    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-certs" pod "1ab8f161-e5ca-4218-917c-8fb515ef3099" (UID: "1ab8f161-e5ca-4218-917c-8fb515ef3099"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.934980 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.934965    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ab8f161-e5ca-4218-917c-8fb515ef3099-istiod-ca-cert" pod "1ab8f161-e5ca-4218-917c-8fb515ef3099" (UID: "1ab8f161-e5ca-4218-917c-8fb515ef3099"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:04:02.935247 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.935221    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-envoy" pod "33e74325-ee0f-43be-b4ef-c7ddf3778d43" (UID: "33e74325-ee0f-43be-b4ef-c7ddf3778d43"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:04:02.935661 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.935584    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-podinfo" pod "33e74325-ee0f-43be-b4ef-c7ddf3778d43" (UID: "33e74325-ee0f-43be-b4ef-c7ddf3778d43"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:04:02.935661 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.935617    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-token" pod "1ab8f161-e5ca-4218-917c-8fb515ef3099" (UID: "1ab8f161-e5ca-4218-917c-8fb515ef3099"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:04:02.935862 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.935792    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-kube-api-access-r5kzz" pod "1ab8f161-e5ca-4218-917c-8fb515ef3099" (UID: "1ab8f161-e5ca-4218-917c-8fb515ef3099"). InnerVolumeSpecName "kube-api-access-r5kzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:04:02.936367 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.936299    6015 scope.go:122] "RemoveContainer" containerID="f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd"
Oct 30 20:04:02.936628 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.936598    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-kube-api-access-rm6qd" pod "33e74325-ee0f-43be-b4ef-c7ddf3778d43" (UID: "33e74325-ee0f-43be-b4ef-c7ddf3778d43"). InnerVolumeSpecName "kube-api-access-rm6qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:04:02.936711 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:04:02.936631    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd\": container with ID starting with f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd not found: ID does not exist" containerID="f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd"
Oct 30 20:04:02.936711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.936655    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd"} err="failed to get container status \"f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd\": rpc error: code = NotFound desc = could not find container \"f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd\": container with ID starting with f7dd5be7781bd40c807ada961019fd974899eaf33b718f68ec2be49efde72ccd not found: ID does not exist"
Oct 30 20:04:02.936711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.936673    6015 scope.go:122] "RemoveContainer" containerID="4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3"
Oct 30 20:04:02.937023 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.937004    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-podinfo" pod "1ab8f161-e5ca-4218-917c-8fb515ef3099" (UID: "1ab8f161-e5ca-4218-917c-8fb515ef3099"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:04:02.946530 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.946509    6015 scope.go:122] "RemoveContainer" containerID="4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3"
Oct 30 20:04:02.946849 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:04:02.946826    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3\": container with ID starting with 4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3 not found: ID does not exist" containerID="4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3"
Oct 30 20:04:02.946911 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.946859    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3"} err="failed to get container status \"4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3\": rpc error: code = NotFound desc = could not find container \"4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3\": container with ID starting with 4f40c88ce2ab81cfc94acd481916de659ff9363e8d415c9a6c30857317fd43f3 not found: ID does not exist"
Oct 30 20:04:02.946911 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.946883    6015 scope.go:122] "RemoveContainer" containerID="56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8"
Oct 30 20:04:02.956662 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.956640    6015 scope.go:122] "RemoveContainer" containerID="56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8"
Oct 30 20:04:02.957026 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:04:02.956980    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8\": container with ID starting with 56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8 not found: ID does not exist" containerID="56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8"
Oct 30 20:04:02.957140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:02.957027    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8"} err="failed to get container status \"56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8\": rpc error: code = NotFound desc = could not find container \"56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8\": container with ID starting with 56ee4206073bd9b0c0f958a9595317e780218817eb9d6152d53b2bcb074e2be8 not found: ID does not exist"
Oct 30 20:04:03.034689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.034589    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5kzz\" (UniqueName: \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-kube-api-access-r5kzz\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:03.034689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.034629    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm6qd\" (UniqueName: \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-kube-api-access-rm6qd\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:03.034689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.034641    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:03.034689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.034650    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:03.034689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.034659    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33e74325-ee0f-43be-b4ef-c7ddf3778d43-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:03.034689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.034670    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:03.034689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.034678    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:03.034689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.034687    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ab8f161-e5ca-4218-917c-8fb515ef3099-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:03.034689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.034695    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:03.035132 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.034702    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ab8f161-e5ca-4218-917c-8fb515ef3099-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:04:03.177574 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.177541    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"]
Oct 30 20:04:03.186877 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.186840    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-zqnbt"]
Oct 30 20:04:03.404233 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.404189    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"]
Oct 30 20:04:03.409200 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.409142    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-859kr"]
Oct 30 20:04:03.514001 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.513968    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"]
Oct 30 20:04:03.520085 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.520049    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-8shs8"]
Oct 30 20:04:03.585975 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.585937    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" path="/var/lib/kubelet/pods/1390fa61-d871-4ad0-ab4b-0b581a7cb08f/volumes"
Oct 30 20:04:03.586659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.586641    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" path="/var/lib/kubelet/pods/1ab8f161-e5ca-4218-917c-8fb515ef3099/volumes"
Oct 30 20:04:03.587235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:03.587218    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" path="/var/lib/kubelet/pods/33e74325-ee0f-43be-b4ef-c7ddf3778d43/volumes"
Oct 30 20:04:05.384268 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:05.384232    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:05.876338 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:05.876303    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:04:09.109663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:09.109623    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:09.659428 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:09.659393    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:10.754375 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.754342    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"]
Oct 30 20:04:10.755070 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.755050    6015 cpu_manager.go:414] "containerMap: removing container" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy"
Oct 30 20:04:10.755156 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.755070    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy"
Oct 30 20:04:10.755156 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.755122    6015 cpu_manager.go:414] "containerMap: removing container" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy"
Oct 30 20:04:10.755156 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.755130    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy"
Oct 30 20:04:10.755156 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.755149    6015 cpu_manager.go:414] "containerMap: removing container" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy"
Oct 30 20:04:10.755364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.755159    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy"
Oct 30 20:04:10.755364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.755311    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="1390fa61-d871-4ad0-ab4b-0b581a7cb08f" containerName="istio-proxy"
Oct 30 20:04:10.755364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.755330    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ab8f161-e5ca-4218-917c-8fb515ef3099" containerName="istio-proxy"
Oct 30 20:04:10.755364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.755340    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="33e74325-ee0f-43be-b4ef-c7ddf3778d43" containerName="istio-proxy"
Oct 30 20:04:10.760662 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.760642    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:04:10.813373 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.813338    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"]
Oct 30 20:04:10.838800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.838758    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r\" (UID: \"9e5cb63a-2b42-4ddd-93a4-869d39867d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:04:10.839003 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.838917    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp82f\" (UniqueName: \"kubernetes.io/projected/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-kube-api-access-gp82f\") pod \"payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r\" (UID: \"9e5cb63a-2b42-4ddd-93a4-869d39867d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:04:10.856470 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.856431    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-3f9b9b\""
Oct 30 20:04:10.856470 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.856466    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-3f9b9b-dockercfg-72spz\""
Oct 30 20:04:10.940602 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.940560    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r\" (UID: \"9e5cb63a-2b42-4ddd-93a4-869d39867d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:04:10.940844 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.940656    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp82f\" (UniqueName: \"kubernetes.io/projected/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-kube-api-access-gp82f\") pod \"payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r\" (UID: \"9e5cb63a-2b42-4ddd-93a4-869d39867d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:04:10.941308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.941286    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r\" (UID: \"9e5cb63a-2b42-4ddd-93a4-869d39867d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:04:10.999545 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:10.999504    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp82f\" (UniqueName: \"kubernetes.io/projected/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-kube-api-access-gp82f\") pod \"payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r\" (UID: \"9e5cb63a-2b42-4ddd-93a4-869d39867d3e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:04:11.076446 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.076402    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:04:11.453659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.453570    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"]
Oct 30 20:04:11.458079 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:04:11.458051    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5cb63a_2b42_4ddd_93a4_869d39867d3e.slice/crio-46c049b3c6b75d0516b45e313b8ef8e04e2d482f328a1a66c7312ba4be467c93 WatchSource:0}: Error finding container 46c049b3c6b75d0516b45e313b8ef8e04e2d482f328a1a66c7312ba4be467c93: Status 404 returned error can't find the container with id 46c049b3c6b75d0516b45e313b8ef8e04e2d482f328a1a66c7312ba4be467c93
Oct 30 20:04:11.505245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.505213    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"]
Oct 30 20:04:11.510932 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.510907    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:04:11.563613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.563576    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"]
Oct 30 20:04:11.649405 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.649370    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d29fab5-72f9-4bd8-995d-a02cc241957e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2\" (UID: \"9d29fab5-72f9-4bd8-995d-a02cc241957e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:04:11.649620 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.649579    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw8vd\" (UniqueName: \"kubernetes.io/projected/9d29fab5-72f9-4bd8-995d-a02cc241957e-kube-api-access-xw8vd\") pod \"payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2\" (UID: \"9d29fab5-72f9-4bd8-995d-a02cc241957e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:04:11.750668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.750582    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw8vd\" (UniqueName: \"kubernetes.io/projected/9d29fab5-72f9-4bd8-995d-a02cc241957e-kube-api-access-xw8vd\") pod \"payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2\" (UID: \"9d29fab5-72f9-4bd8-995d-a02cc241957e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:04:11.750668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.750665    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d29fab5-72f9-4bd8-995d-a02cc241957e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2\" (UID: \"9d29fab5-72f9-4bd8-995d-a02cc241957e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:04:11.751577 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.751551    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d29fab5-72f9-4bd8-995d-a02cc241957e-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2\" (UID: \"9d29fab5-72f9-4bd8-995d-a02cc241957e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:04:11.809570 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.809535    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw8vd\" (UniqueName: \"kubernetes.io/projected/9d29fab5-72f9-4bd8-995d-a02cc241957e-kube-api-access-xw8vd\") pod \"payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2\" (UID: \"9d29fab5-72f9-4bd8-995d-a02cc241957e\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:04:11.827513 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.827478    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:04:11.990234 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.990190    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r" event={"ID":"9e5cb63a-2b42-4ddd-93a4-869d39867d3e","Type":"ContainerStarted","Data":"14e4bea4cb1d72566062ad30ff425e9b52478365192a50865bdd818dc23ff207"}
Oct 30 20:04:11.990409 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.990287    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:04:11.990409 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:11.990309    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r" event={"ID":"9e5cb63a-2b42-4ddd-93a4-869d39867d3e","Type":"ContainerStarted","Data":"46c049b3c6b75d0516b45e313b8ef8e04e2d482f328a1a66c7312ba4be467c93"}
Oct 30 20:04:12.102162 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:12.102109    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r" podStartSLOduration=2.102090759 podStartE2EDuration="2.102090759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:12.099824871 +0000 UTC m=+2314.642632152" watchObservedRunningTime="2026-10-30 20:04:12.102090759 +0000 UTC m=+2314.644898023"
Oct 30 20:04:12.211884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:12.211843    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"]
Oct 30 20:04:12.220542 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:04:12.220479    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d29fab5_72f9_4bd8_995d_a02cc241957e.slice/crio-e213a4b769c8e592098b6625b1793dd5ff58a7578f43d20115c8b4908dd38307 WatchSource:0}: Error finding container e213a4b769c8e592098b6625b1793dd5ff58a7578f43d20115c8b4908dd38307: Status 404 returned error can't find the container with id e213a4b769c8e592098b6625b1793dd5ff58a7578f43d20115c8b4908dd38307
Oct 30 20:04:12.794533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:12.794496    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:13.000315 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:13.000271    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2" event={"ID":"9d29fab5-72f9-4bd8-995d-a02cc241957e","Type":"ContainerStarted","Data":"ad69904212655448e2e36c03637519ec3e35e2fed47b6274788120a199270b25"}
Oct 30 20:04:13.000892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:13.000343    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2" event={"ID":"9d29fab5-72f9-4bd8-995d-a02cc241957e","Type":"ContainerStarted","Data":"e213a4b769c8e592098b6625b1793dd5ff58a7578f43d20115c8b4908dd38307"}
Oct 30 20:04:13.000892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:13.000600    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:04:13.113208 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:13.113099    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2" podStartSLOduration=2.113083919 podStartE2EDuration="2.113083919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:13.111638734 +0000 UTC m=+2315.654445999" watchObservedRunningTime="2026-10-30 20:04:13.113083919 +0000 UTC m=+2315.655891185"
Oct 30 20:04:18.370911 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:18.370876    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:22.120260 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:22.120211    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:22.647602 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:22.647561    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:23.003026 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.002937    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:04:23.738796 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.738750    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"]
Oct 30 20:04:23.743516 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.743493    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:04:23.797757 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.797725    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-eaa6d2\""
Oct 30 20:04:23.801677 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.801640    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"]
Oct 30 20:04:23.818220 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.818179    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a37019c-fd55-43e6-a457-6f389275ebb6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq\" (UID: \"6a37019c-fd55-43e6-a457-6f389275ebb6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:04:23.818407 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.818256    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdrp9\" (UniqueName: \"kubernetes.io/projected/6a37019c-fd55-43e6-a457-6f389275ebb6-kube-api-access-pdrp9\") pod \"payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq\" (UID: \"6a37019c-fd55-43e6-a457-6f389275ebb6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:04:23.842664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.842634    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-eaa6d2-dockercfg-5cbgq\""
Oct 30 20:04:23.920331 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.920287    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a37019c-fd55-43e6-a457-6f389275ebb6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq\" (UID: \"6a37019c-fd55-43e6-a457-6f389275ebb6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:04:23.920552 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.920382    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdrp9\" (UniqueName: \"kubernetes.io/projected/6a37019c-fd55-43e6-a457-6f389275ebb6-kube-api-access-pdrp9\") pod \"payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq\" (UID: \"6a37019c-fd55-43e6-a457-6f389275ebb6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:04:23.921270 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.921238    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a37019c-fd55-43e6-a457-6f389275ebb6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq\" (UID: \"6a37019c-fd55-43e6-a457-6f389275ebb6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:04:23.979232 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:23.979202    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdrp9\" (UniqueName: \"kubernetes.io/projected/6a37019c-fd55-43e6-a457-6f389275ebb6-kube-api-access-pdrp9\") pod \"payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq\" (UID: \"6a37019c-fd55-43e6-a457-6f389275ebb6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:04:24.010639 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.010564    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:04:24.059385 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.059352    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:04:24.437339 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.437302    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"]
Oct 30 20:04:24.442344 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:04:24.442310    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a37019c_fd55_43e6_a457_6f389275ebb6.slice/crio-a8a95c484809f668e3aa149f176f2aa37566500f8eb3cd7d4161605d30313e9a WatchSource:0}: Error finding container a8a95c484809f668e3aa149f176f2aa37566500f8eb3cd7d4161605d30313e9a: Status 404 returned error can't find the container with id a8a95c484809f668e3aa149f176f2aa37566500f8eb3cd7d4161605d30313e9a
Oct 30 20:04:24.487445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.487413    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"]
Oct 30 20:04:24.493485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.493456    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:04:24.528390 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.528349    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn\" (UID: \"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:04:24.528536 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.528412    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjlgx\" (UniqueName: \"kubernetes.io/projected/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-kube-api-access-kjlgx\") pod \"payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn\" (UID: \"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:04:24.548223 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.548184    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"]
Oct 30 20:04:24.630026 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.629984    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn\" (UID: \"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:04:24.630234 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.630202    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjlgx\" (UniqueName: \"kubernetes.io/projected/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-kube-api-access-kjlgx\") pod \"payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn\" (UID: \"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:04:24.630684 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.630661    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn\" (UID: \"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:04:24.688866 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.688837    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjlgx\" (UniqueName: \"kubernetes.io/projected/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-kube-api-access-kjlgx\") pod \"payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn\" (UID: \"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:04:24.815425 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:24.815393    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:04:25.130233 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:25.130117    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq" event={"ID":"6a37019c-fd55-43e6-a457-6f389275ebb6","Type":"ContainerStarted","Data":"0d47de205ad33abf4455c9af095e1ff04badf77ae80c68ddaffe78c9fc1bc3ed"}
Oct 30 20:04:25.130233 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:25.130174    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq" event={"ID":"6a37019c-fd55-43e6-a457-6f389275ebb6","Type":"ContainerStarted","Data":"a8a95c484809f668e3aa149f176f2aa37566500f8eb3cd7d4161605d30313e9a"}
Oct 30 20:04:25.130482 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:25.130259    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:04:25.192934 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:25.192896    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"]
Oct 30 20:04:25.203762 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:04:25.203709    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c71fd0e_cdb3_48dc_94f8_c5a33f3b6731.slice/crio-2f5a0efe37b29d97a3632b8f9694a4e43984f704ef6effa8206b50d9d4f8aa0e WatchSource:0}: Error finding container 2f5a0efe37b29d97a3632b8f9694a4e43984f704ef6effa8206b50d9d4f8aa0e: Status 404 returned error can't find the container with id 2f5a0efe37b29d97a3632b8f9694a4e43984f704ef6effa8206b50d9d4f8aa0e
Oct 30 20:04:25.242744 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:25.242690    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq" podStartSLOduration=2.242675633 podStartE2EDuration="2.242675633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:25.240460481 +0000 UTC m=+2327.783267746" watchObservedRunningTime="2026-10-30 20:04:25.242675633 +0000 UTC m=+2327.785482897"
Oct 30 20:04:25.414600 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:25.414509    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:26.138862 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:26.138822    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn" event={"ID":"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731","Type":"ContainerStarted","Data":"cd3d00c2641257adf9bfaf14cb455d7f1462ac46f1a3f941a1c863223cd91c9c"}
Oct 30 20:04:26.139299 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:26.138888    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn" event={"ID":"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731","Type":"ContainerStarted","Data":"2f5a0efe37b29d97a3632b8f9694a4e43984f704ef6effa8206b50d9d4f8aa0e"}
Oct 30 20:04:26.139299 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:26.139054    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:04:26.251598 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:26.251540    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn" podStartSLOduration=2.251526229 podStartE2EDuration="2.251526229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:04:26.24965291 +0000 UTC m=+2328.792460177" watchObservedRunningTime="2026-10-30 20:04:26.251526229 +0000 UTC m=+2328.794333493"
Oct 30 20:04:28.217378 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:04:28.217341    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:04:30.967299 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:30.967258    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:36.140941 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:36.140905    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:04:36.250353 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:36.250300    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:36.416673 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:36.416579    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:36.577008 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:36.576959    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:37.148876 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:37.148797    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:04:41.666203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:41.666164    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:45.444800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:45.444760    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:45.999303 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:45.999204    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:48.818387 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:48.818342    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:52.170978 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:52.170940    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:53.231414 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:53.231379    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:53.776848 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:53.775582    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:53.935671 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:53.935641    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:54.903870 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:54.903827    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:55.113061 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:55.113014    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:55.270194 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:55.270091    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:55.427025 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:55.426990    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:55.960654 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:04:55.960614    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:04:58.216697 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:04:58.216653    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:05:00.254780 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:00.254745    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:00.630489 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:00.630452    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"]
Oct 30 20:05:00.630774 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:00.630741    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8" podUID="e7918fa4-3cee-40d5-bac7-bf1b08ea7a26" containerName="payload-processing" containerID="cri-o://791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2" gracePeriod=30
Oct 30 20:05:00.695997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:00.695957    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"]
Oct 30 20:05:00.696188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:00.696167    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v" podUID="30aad67f-3694-41c0-a4b2-303665e009a8" containerName="payload-pre-processing" containerID="cri-o://5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d" gracePeriod=30
Oct 30 20:05:01.029005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.028975    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:05:01.051147 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.051117    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-plugins-config-volume\") pod \"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26\" (UID: \"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26\") "
Oct 30 20:05:01.051345 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.051329    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-kube-api-access-8v269\" (UniqueName: \"kubernetes.io/projected/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-kube-api-access-8v269\") pod \"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26\" (UID: \"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26\") "
Oct 30 20:05:01.051538 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.051503    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-plugins-config-volume" pod "e7918fa4-3cee-40d5-bac7-bf1b08ea7a26" (UID: "e7918fa4-3cee-40d5-bac7-bf1b08ea7a26"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:05:01.051916 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.051897    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:01.053784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.053758    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-kube-api-access-8v269" pod "e7918fa4-3cee-40d5-bac7-bf1b08ea7a26" (UID: "e7918fa4-3cee-40d5-bac7-bf1b08ea7a26"). InnerVolumeSpecName "kube-api-access-8v269". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:01.075269 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.075235    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:05:01.152534 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.152446    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/30aad67f-3694-41c0-a4b2-303665e009a8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30aad67f-3694-41c0-a4b2-303665e009a8-plugins-config-volume\") pod \"30aad67f-3694-41c0-a4b2-303665e009a8\" (UID: \"30aad67f-3694-41c0-a4b2-303665e009a8\") "
Oct 30 20:05:01.152719 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.152623    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30aad67f-3694-41c0-a4b2-303665e009a8-kube-api-access-kr5b7\" (UniqueName: \"kubernetes.io/projected/30aad67f-3694-41c0-a4b2-303665e009a8-kube-api-access-kr5b7\") pod \"30aad67f-3694-41c0-a4b2-303665e009a8\" (UID: \"30aad67f-3694-41c0-a4b2-303665e009a8\") "
Oct 30 20:05:01.152933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.152905    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30aad67f-3694-41c0-a4b2-303665e009a8-plugins-config-volume" pod "30aad67f-3694-41c0-a4b2-303665e009a8" (UID: "30aad67f-3694-41c0-a4b2-303665e009a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:05:01.153266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.153245    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v269\" (UniqueName: \"kubernetes.io/projected/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26-kube-api-access-8v269\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:01.153266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.153272    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30aad67f-3694-41c0-a4b2-303665e009a8-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:01.155469 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.155440    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30aad67f-3694-41c0-a4b2-303665e009a8-kube-api-access-kr5b7" pod "30aad67f-3694-41c0-a4b2-303665e009a8" (UID: "30aad67f-3694-41c0-a4b2-303665e009a8"). InnerVolumeSpecName "kube-api-access-kr5b7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:01.255829 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.255705    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr5b7\" (UniqueName: \"kubernetes.io/projected/30aad67f-3694-41c0-a4b2-303665e009a8-kube-api-access-kr5b7\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:01.401900 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.401854    6015 generic.go:356] "Generic (PLEG): container finished" podID="30aad67f-3694-41c0-a4b2-303665e009a8" containerID="5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d" exitCode=0
Oct 30 20:05:01.402081 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.401922    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"
Oct 30 20:05:01.402081 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.401923    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v" event={"ID":"30aad67f-3694-41c0-a4b2-303665e009a8","Type":"ContainerDied","Data":"5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d"}
Oct 30 20:05:01.402081 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.401988    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v" event={"ID":"30aad67f-3694-41c0-a4b2-303665e009a8","Type":"ContainerDied","Data":"e9ea69655fa726a24af03b8b3ded87246c85c9f5705f853d87c748dc71fc0637"}
Oct 30 20:05:01.402081 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.402019    6015 scope.go:122] "RemoveContainer" containerID="5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d"
Oct 30 20:05:01.403757 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.403627    6015 generic.go:356] "Generic (PLEG): container finished" podID="e7918fa4-3cee-40d5-bac7-bf1b08ea7a26" containerID="791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2" exitCode=0
Oct 30 20:05:01.403757 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.403670    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"
Oct 30 20:05:01.403757 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.403699    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8" event={"ID":"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26","Type":"ContainerDied","Data":"791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2"}
Oct 30 20:05:01.403757 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.403771    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8" event={"ID":"e7918fa4-3cee-40d5-bac7-bf1b08ea7a26","Type":"ContainerDied","Data":"cc2e76d71e5e6cb8bac92ef4f33a4823434a2db6dd463f9937d53ec688a25500"}
Oct 30 20:05:01.427314 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.427289    6015 scope.go:122] "RemoveContainer" containerID="5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d"
Oct 30 20:05:01.427637 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:05:01.427614    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d\": container with ID starting with 5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d not found: ID does not exist" containerID="5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d"
Oct 30 20:05:01.427737 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.427643    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d"} err="failed to get container status \"5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d\": rpc error: code = NotFound desc = could not find container \"5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d\": container with ID starting with 5999e948709bc7e6ea3d2b10512258b65d70046b6cd8edf395b202b64c2e8a5d not found: ID does not exist"
Oct 30 20:05:01.427737 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.427662    6015 scope.go:122] "RemoveContainer" containerID="791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2"
Oct 30 20:05:01.437929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.437908    6015 scope.go:122] "RemoveContainer" containerID="791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2"
Oct 30 20:05:01.438242 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:05:01.438219    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2\": container with ID starting with 791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2 not found: ID does not exist" containerID="791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2"
Oct 30 20:05:01.438302 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.438251    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2"} err="failed to get container status \"791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2\": rpc error: code = NotFound desc = could not find container \"791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2\": container with ID starting with 791bb1ca9d15fc0802663994f8fb267f6985811477b032a6402f03597e144ac2 not found: ID does not exist"
Oct 30 20:05:01.563571 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.563523    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"]
Oct 30 20:05:01.567472 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.567445    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ffe14b-7b5976df9d-8sdg8"]
Oct 30 20:05:01.588340 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.588303    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7918fa4-3cee-40d5-bac7-bf1b08ea7a26" path="/var/lib/kubelet/pods/e7918fa4-3cee-40d5-bac7-bf1b08ea7a26/volumes"
Oct 30 20:05:01.624037 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.624004    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:01.682848 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.682742    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"]
Oct 30 20:05:01.688357 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.687102    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ffe14b-64f9c4f8c9-thq5v"]
Oct 30 20:05:01.963475 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:01.963378    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:02.140501 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:02.140466    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:02.310001 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:02.309956    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:02.946188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:02.946147    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:03.372220 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:03.372179    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:03.587713 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:03.587682    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30aad67f-3694-41c0-a4b2-303665e009a8" path="/var/lib/kubelet/pods/30aad67f-3694-41c0-a4b2-303665e009a8/volumes"
Oct 30 20:05:03.636142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:03.636044    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:03.792772 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:03.792730    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:03.953090 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:03.952980    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:03.959786 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:03.959756    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"]
Oct 30 20:05:03.960067 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:03.960042    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy" containerID="cri-o://c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02" gracePeriod=30
Oct 30 20:05:04.115523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:04.115487    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:04.420155 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:04.420121    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:08.171997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:08.171967    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:08.750852 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:08.750779    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:09.306620 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.306592    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 20:05:09.392371 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392275    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-data\") pod \"e2d8df69-ea03-48d6-827b-4307d06caad6\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") "
Oct 30 20:05:09.392371 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392333    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-credential-socket\") pod \"e2d8df69-ea03-48d6-827b-4307d06caad6\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") "
Oct 30 20:05:09.392612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392393    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-kube-api-access-c6wv2\" (UniqueName: \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-kube-api-access-c6wv2\") pod \"e2d8df69-ea03-48d6-827b-4307d06caad6\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") "
Oct 30 20:05:09.392612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392417    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-certs\") pod \"e2d8df69-ea03-48d6-827b-4307d06caad6\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") "
Oct 30 20:05:09.392612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392472    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-podinfo\") pod \"e2d8df69-ea03-48d6-827b-4307d06caad6\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") "
Oct 30 20:05:09.392612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392507    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-token\" (UniqueName: \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-token\") pod \"e2d8df69-ea03-48d6-827b-4307d06caad6\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") "
Oct 30 20:05:09.392612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392538    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-envoy\") pod \"e2d8df69-ea03-48d6-827b-4307d06caad6\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") "
Oct 30 20:05:09.392612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392601    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2d8df69-ea03-48d6-827b-4307d06caad6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d8df69-ea03-48d6-827b-4307d06caad6-istiod-ca-cert\") pod \"e2d8df69-ea03-48d6-827b-4307d06caad6\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") "
Oct 30 20:05:09.392957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392625    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-data" pod "e2d8df69-ea03-48d6-827b-4307d06caad6" (UID: "e2d8df69-ea03-48d6-827b-4307d06caad6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:09.392957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392667    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-credential-socket" pod "e2d8df69-ea03-48d6-827b-4307d06caad6" (UID: "e2d8df69-ea03-48d6-827b-4307d06caad6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:09.392957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392696    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-socket\") pod \"e2d8df69-ea03-48d6-827b-4307d06caad6\" (UID: \"e2d8df69-ea03-48d6-827b-4307d06caad6\") "
Oct 30 20:05:09.393105 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.392979    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-socket" pod "e2d8df69-ea03-48d6-827b-4307d06caad6" (UID: "e2d8df69-ea03-48d6-827b-4307d06caad6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:09.393105 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.393038    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2d8df69-ea03-48d6-827b-4307d06caad6-istiod-ca-cert" pod "e2d8df69-ea03-48d6-827b-4307d06caad6" (UID: "e2d8df69-ea03-48d6-827b-4307d06caad6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:05:09.393199 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.393163    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-certs" pod "e2d8df69-ea03-48d6-827b-4307d06caad6" (UID: "e2d8df69-ea03-48d6-827b-4307d06caad6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:09.393564 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.393544    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:09.393630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.393574    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:09.393630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.393589    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:09.393630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.393604    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2d8df69-ea03-48d6-827b-4307d06caad6-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:09.393630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.393618    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:09.395006 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.394971    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-envoy" pod "e2d8df69-ea03-48d6-827b-4307d06caad6" (UID: "e2d8df69-ea03-48d6-827b-4307d06caad6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:09.395123 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.395052    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-kube-api-access-c6wv2" pod "e2d8df69-ea03-48d6-827b-4307d06caad6" (UID: "e2d8df69-ea03-48d6-827b-4307d06caad6"). InnerVolumeSpecName "kube-api-access-c6wv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:09.395350 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.395329    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-podinfo" pod "e2d8df69-ea03-48d6-827b-4307d06caad6" (UID: "e2d8df69-ea03-48d6-827b-4307d06caad6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:05:09.395444 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.395363    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-token" pod "e2d8df69-ea03-48d6-827b-4307d06caad6" (UID: "e2d8df69-ea03-48d6-827b-4307d06caad6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:09.464390 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.464356    6015 generic.go:356] "Generic (PLEG): container finished" podID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerID="c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02" exitCode=0
Oct 30 20:05:09.464573 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.464430    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"
Oct 30 20:05:09.464573 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.464440    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" event={"ID":"e2d8df69-ea03-48d6-827b-4307d06caad6","Type":"ContainerDied","Data":"c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02"}
Oct 30 20:05:09.464573 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.464500    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln" event={"ID":"e2d8df69-ea03-48d6-827b-4307d06caad6","Type":"ContainerDied","Data":"e73a111bdd17c5d779df69acaddad80140d67c3f32aeae0eb876737b7dd27032"}
Oct 30 20:05:09.464573 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.464523    6015 scope.go:122] "RemoveContainer" containerID="c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02"
Oct 30 20:05:09.479081 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.479056    6015 scope.go:122] "RemoveContainer" containerID="b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879"
Oct 30 20:05:09.490724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.490701    6015 scope.go:122] "RemoveContainer" containerID="c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02"
Oct 30 20:05:09.491087 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:05:09.491058    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02\": container with ID starting with c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02 not found: ID does not exist" containerID="c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02"
Oct 30 20:05:09.491200 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.491096    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02"} err="failed to get container status \"c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02\": rpc error: code = NotFound desc = could not find container \"c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02\": container with ID starting with c8fda53cb3b21f132d8dcc1df3e0dbd4ab51dd9893e39462b0c06402c3f73e02 not found: ID does not exist"
Oct 30 20:05:09.491200 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.491123    6015 scope.go:122] "RemoveContainer" containerID="b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879"
Oct 30 20:05:09.491469 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:05:09.491446    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879\": container with ID starting with b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879 not found: ID does not exist" containerID="b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879"
Oct 30 20:05:09.491546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.491478    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879"} err="failed to get container status \"b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879\": rpc error: code = NotFound desc = could not find container \"b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879\": container with ID starting with b7606c63e943980d5de80a3af91ce40a4c127cf730ee8fccc46b92904940d879 not found: ID does not exist"
Oct 30 20:05:09.495563 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.495526    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6wv2\" (UniqueName: \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-kube-api-access-c6wv2\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:09.495688 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.495561    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:09.495688 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.495578    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:09.495688 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.495591    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2d8df69-ea03-48d6-827b-4307d06caad6-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:09.625260 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.625220    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"]
Oct 30 20:05:09.631499 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.631466    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-d80c7d-openshift-default-79c8d4d7c5-wb9ln"]
Oct 30 20:05:09.806085 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806051    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"]
Oct 30 20:05:09.806664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806648    6015 cpu_manager.go:414] "containerMap: removing container" podUID="30aad67f-3694-41c0-a4b2-303665e009a8" containerName="payload-pre-processing"
Oct 30 20:05:09.806664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806665    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30aad67f-3694-41c0-a4b2-303665e009a8" containerName="payload-pre-processing"
Oct 30 20:05:09.806790 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806692    6015 cpu_manager.go:414] "containerMap: removing container" podUID="e7918fa4-3cee-40d5-bac7-bf1b08ea7a26" containerName="payload-processing"
Oct 30 20:05:09.806790 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806697    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7918fa4-3cee-40d5-bac7-bf1b08ea7a26" containerName="payload-processing"
Oct 30 20:05:09.806790 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806728    6015 cpu_manager.go:414] "containerMap: removing container" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy"
Oct 30 20:05:09.806790 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806732    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy"
Oct 30 20:05:09.806790 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806740    6015 cpu_manager.go:414] "containerMap: removing container" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy"
Oct 30 20:05:09.806790 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806744    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy"
Oct 30 20:05:09.807009 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806855    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy"
Oct 30 20:05:09.807009 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806863    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" containerName="istio-proxy"
Oct 30 20:05:09.807009 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806871    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="30aad67f-3694-41c0-a4b2-303665e009a8" containerName="payload-pre-processing"
Oct 30 20:05:09.807009 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.806880    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7918fa4-3cee-40d5-bac7-bf1b08ea7a26" containerName="payload-processing"
Oct 30 20:05:09.811674 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.811651    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:05:09.861203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.861141    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-77a92c\""
Oct 30 20:05:09.861659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.861634    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-77a92c-dockercfg-z2l56\""
Oct 30 20:05:09.864589 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.864531    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"]
Oct 30 20:05:09.903123 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.903079    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr\" (UID: \"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:05:09.903302 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:09.903135    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvzjr\" (UniqueName: \"kubernetes.io/projected/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-kube-api-access-gvzjr\") pod \"payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr\" (UID: \"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:05:10.004998 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.004957    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr\" (UID: \"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:05:10.005209 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.005010    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvzjr\" (UniqueName: \"kubernetes.io/projected/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-kube-api-access-gvzjr\") pod \"payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr\" (UID: \"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:05:10.005736 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.005707    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr\" (UID: \"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:05:10.063433 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.063361    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvzjr\" (UniqueName: \"kubernetes.io/projected/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-kube-api-access-gvzjr\") pod \"payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr\" (UID: \"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:05:10.126372 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.126338    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:05:10.366917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.366788    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:10.438943 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.438903    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"]
Oct 30 20:05:10.444648 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.444621    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:05:10.499194 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.499157    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"]
Oct 30 20:05:10.509926 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.509893    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"]
Oct 30 20:05:10.518997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.518961    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:10.529056 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:05:10.529003    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded97e0f8_4158_4b7c_9cee_77e9dd6fab93.slice/crio-06183d86f58466f763136fd8168fa1a2d2b69c400394c36d14314ebdfe9e18ab WatchSource:0}: Error finding container 06183d86f58466f763136fd8168fa1a2d2b69c400394c36d14314ebdfe9e18ab: Status 404 returned error can't find the container with id 06183d86f58466f763136fd8168fa1a2d2b69c400394c36d14314ebdfe9e18ab
Oct 30 20:05:10.612981 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.612953    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8\" (UID: \"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:05:10.613095 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.613007    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m92x2\" (UniqueName: \"kubernetes.io/projected/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-kube-api-access-m92x2\") pod \"payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8\" (UID: \"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:05:10.714798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.714685    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8\" (UID: \"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:05:10.715001 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.714791    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m92x2\" (UniqueName: \"kubernetes.io/projected/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-kube-api-access-m92x2\") pod \"payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8\" (UID: \"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:05:10.715379 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.715360    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8\" (UID: \"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:05:10.738504 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.738466    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:10.774188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:10.774157    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m92x2\" (UniqueName: \"kubernetes.io/projected/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-kube-api-access-m92x2\") pod \"payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8\" (UID: \"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:05:11.059954 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.059916    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:05:11.445884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.445782    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"]
Oct 30 20:05:11.451134 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:05:11.451102    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284a9a1a_2093_4dc4_9ffd_b4a77d0d1261.slice/crio-300d1baaf1bde13863b5595d5eb2ecb6dcab3b75123ce0abb391263ab490f994 WatchSource:0}: Error finding container 300d1baaf1bde13863b5595d5eb2ecb6dcab3b75123ce0abb391263ab490f994: Status 404 returned error can't find the container with id 300d1baaf1bde13863b5595d5eb2ecb6dcab3b75123ce0abb391263ab490f994
Oct 30 20:05:11.463647 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.463621    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:11.484322 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.484285    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr" event={"ID":"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93","Type":"ContainerStarted","Data":"04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc"}
Oct 30 20:05:11.484467 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.484355    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr" event={"ID":"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93","Type":"ContainerStarted","Data":"06183d86f58466f763136fd8168fa1a2d2b69c400394c36d14314ebdfe9e18ab"}
Oct 30 20:05:11.484586 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.484460    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:05:11.488364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.488333    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8" event={"ID":"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261","Type":"ContainerStarted","Data":"300d1baaf1bde13863b5595d5eb2ecb6dcab3b75123ce0abb391263ab490f994"}
Oct 30 20:05:11.588122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.588089    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e2d8df69-ea03-48d6-827b-4307d06caad6" path="/var/lib/kubelet/pods/e2d8df69-ea03-48d6-827b-4307d06caad6/volumes"
Oct 30 20:05:11.598830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.598754    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr" podStartSLOduration=2.598739918 podStartE2EDuration="2.598739918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:11.596713746 +0000 UTC m=+2374.139520993" watchObservedRunningTime="2026-10-30 20:05:11.598739918 +0000 UTC m=+2374.141547243"
Oct 30 20:05:11.651273 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.651226    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:11.772344 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.772251    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"]
Oct 30 20:05:11.772544 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.772511    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy" containerID="cri-o://9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba" gracePeriod=30
Oct 30 20:05:11.822715 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:11.822684    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:12.055583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.055554    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:12.496504 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.496403    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8" event={"ID":"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261","Type":"ContainerStarted","Data":"bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3"}
Oct 30 20:05:12.496504 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.496500    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:05:12.610085 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.610020    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8" podStartSLOduration=2.6099998810000002 podStartE2EDuration="2.609999881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:12.607432156 +0000 UTC m=+2375.150239421" watchObservedRunningTime="2026-10-30 20:05:12.609999881 +0000 UTC m=+2375.152807145"
Oct 30 20:05:12.830099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.830057    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"]
Oct 30 20:05:12.834584 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.834556    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:12.888060 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.888023    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kmwqm\""
Oct 30 20:05:12.893120 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.893085    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"]
Oct 30 20:05:12.952085 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.952045    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czng2\" (UniqueName: \"kubernetes.io/projected/f54e186b-58e7-4c30-99dc-f466a32a5579-kube-api-access-czng2\") pod \"maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:12.952317 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.952169    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:12.952407 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.952354    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:12.975748 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:12.975711    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:05:13.054165 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:13.054126    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:13.054378 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:13.054290    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:13.054378 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:13.054350    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czng2\" (UniqueName: \"kubernetes.io/projected/f54e186b-58e7-4c30-99dc-f466a32a5579-kube-api-access-czng2\") pod \"maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:13.055052 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:13.055021    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:13.057014 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:13.056990    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:13.113722 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:13.113644    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czng2\" (UniqueName: \"kubernetes.io/projected/f54e186b-58e7-4c30-99dc-f466a32a5579-kube-api-access-czng2\") pod \"maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:13.149648 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:13.149600    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:13.538292 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:13.538196    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"]
Oct 30 20:05:13.544345 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:05:13.544316    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54e186b_58e7_4c30_99dc_f466a32a5579.slice/crio-fc39b287aabd17a1f274bac30c48687d0c5420a4a76ab27af1a25d8289141f5b WatchSource:0}: Error finding container fc39b287aabd17a1f274bac30c48687d0c5420a4a76ab27af1a25d8289141f5b: Status 404 returned error can't find the container with id fc39b287aabd17a1f274bac30c48687d0c5420a4a76ab27af1a25d8289141f5b
Oct 30 20:05:14.513441 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:14.513396    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr" event={"ID":"f54e186b-58e7-4c30-99dc-f466a32a5579","Type":"ContainerStarted","Data":"f9b405aab531a92bc64a49faa9130e611bd7812345eae47e8840a7a1eea853fe"}
Oct 30 20:05:14.513654 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:14.513467    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr" event={"ID":"f54e186b-58e7-4c30-99dc-f466a32a5579","Type":"ContainerStarted","Data":"fc39b287aabd17a1f274bac30c48687d0c5420a4a76ab27af1a25d8289141f5b"}
Oct 30 20:05:14.626354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:14.626294    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr" podStartSLOduration=2.626278831 podStartE2EDuration="2.626278831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:14.623512366 +0000 UTC m=+2377.166319658" watchObservedRunningTime="2026-10-30 20:05:14.626278831 +0000 UTC m=+2377.169086095"
Oct 30 20:05:15.522195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:15.522156    6015 generic.go:356] "Generic (PLEG): container finished" podID="f54e186b-58e7-4c30-99dc-f466a32a5579" containerID="f9b405aab531a92bc64a49faa9130e611bd7812345eae47e8840a7a1eea853fe" exitCode=0
Oct 30 20:05:15.522392 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:15.522227    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr" event={"ID":"f54e186b-58e7-4c30-99dc-f466a32a5579","Type":"ContainerDied","Data":"f9b405aab531a92bc64a49faa9130e611bd7812345eae47e8840a7a1eea853fe"}
Oct 30 20:05:16.704300 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:16.704273    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:16.802644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:16.802615    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f54e186b-58e7-4c30-99dc-f466a32a5579-kube-api-access-czng2\" (UniqueName: \"kubernetes.io/projected/f54e186b-58e7-4c30-99dc-f466a32a5579-kube-api-access-czng2\") pod \"f54e186b-58e7-4c30-99dc-f466a32a5579\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") "
Oct 30 20:05:16.802909 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:16.802886    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-xks-ca\") pod \"f54e186b-58e7-4c30-99dc-f466a32a5579\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") "
Oct 30 20:05:16.803001 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:16.802939    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-openshift-ca\") pod \"f54e186b-58e7-4c30-99dc-f466a32a5579\" (UID: \"f54e186b-58e7-4c30-99dc-f466a32a5579\") "
Oct 30 20:05:16.803271 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:16.803245    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-openshift-ca" pod "f54e186b-58e7-4c30-99dc-f466a32a5579" (UID: "f54e186b-58e7-4c30-99dc-f466a32a5579"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:05:16.803599 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:16.803553    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-openshift-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:16.805036 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:16.805012    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f54e186b-58e7-4c30-99dc-f466a32a5579-kube-api-access-czng2" pod "f54e186b-58e7-4c30-99dc-f466a32a5579" (UID: "f54e186b-58e7-4c30-99dc-f466a32a5579"). InnerVolumeSpecName "kube-api-access-czng2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:16.805506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:16.805482    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-xks-ca" pod "f54e186b-58e7-4c30-99dc-f466a32a5579" (UID: "f54e186b-58e7-4c30-99dc-f466a32a5579"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:05:16.904923 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:16.904897    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f54e186b-58e7-4c30-99dc-f466a32a5579-maas-api-xks-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:16.905001 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:16.904926    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czng2\" (UniqueName: \"kubernetes.io/projected/f54e186b-58e7-4c30-99dc-f466a32a5579-kube-api-access-czng2\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:17.073730 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.073703    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 20:05:17.108092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108050    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-envoy\") pod \"c8f94d13-901e-4522-8371-269003fe656f\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") "
Oct 30 20:05:17.108268 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108141    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-kube-api-access-59lxb\" (UniqueName: \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-kube-api-access-59lxb\") pod \"c8f94d13-901e-4522-8371-269003fe656f\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") "
Oct 30 20:05:17.108268 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108239    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8f94d13-901e-4522-8371-269003fe656f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f94d13-901e-4522-8371-269003fe656f-istiod-ca-cert\") pod \"c8f94d13-901e-4522-8371-269003fe656f\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") "
Oct 30 20:05:17.108344 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108283    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-credential-socket\") pod \"c8f94d13-901e-4522-8371-269003fe656f\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") "
Oct 30 20:05:17.108380 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108347    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-istio-token\" (UniqueName: \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-istio-token\") pod \"c8f94d13-901e-4522-8371-269003fe656f\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") "
Oct 30 20:05:17.108427 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108385    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c8f94d13-901e-4522-8371-269003fe656f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f94d13-901e-4522-8371-269003fe656f-istio-podinfo\") pod \"c8f94d13-901e-4522-8371-269003fe656f\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") "
Oct 30 20:05:17.108499 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108471    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-socket\") pod \"c8f94d13-901e-4522-8371-269003fe656f\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") "
Oct 30 20:05:17.108549 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108528    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-data\") pod \"c8f94d13-901e-4522-8371-269003fe656f\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") "
Oct 30 20:05:17.108946 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108642    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-certs\") pod \"c8f94d13-901e-4522-8371-269003fe656f\" (UID: \"c8f94d13-901e-4522-8371-269003fe656f\") "
Oct 30 20:05:17.108946 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108646    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-credential-socket" pod "c8f94d13-901e-4522-8371-269003fe656f" (UID: "c8f94d13-901e-4522-8371-269003fe656f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:17.108946 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108741    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8f94d13-901e-4522-8371-269003fe656f-istiod-ca-cert" pod "c8f94d13-901e-4522-8371-269003fe656f" (UID: "c8f94d13-901e-4522-8371-269003fe656f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:05:17.108946 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108885    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-socket" pod "c8f94d13-901e-4522-8371-269003fe656f" (UID: "c8f94d13-901e-4522-8371-269003fe656f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:17.108946 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.108911    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-data" pod "c8f94d13-901e-4522-8371-269003fe656f" (UID: "c8f94d13-901e-4522-8371-269003fe656f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:17.109450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.109045    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-certs" pod "c8f94d13-901e-4522-8371-269003fe656f" (UID: "c8f94d13-901e-4522-8371-269003fe656f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:17.109450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.109278    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8f94d13-901e-4522-8371-269003fe656f-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:17.109450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.109296    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:17.109450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.109305    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:17.109450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.109314    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:17.109450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.109322    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:17.110940 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.110920    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-istio-token" pod "c8f94d13-901e-4522-8371-269003fe656f" (UID: "c8f94d13-901e-4522-8371-269003fe656f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:17.111070 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.111051    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-kube-api-access-59lxb" pod "c8f94d13-901e-4522-8371-269003fe656f" (UID: "c8f94d13-901e-4522-8371-269003fe656f"). InnerVolumeSpecName "kube-api-access-59lxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:17.111365 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.111344    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-envoy" pod "c8f94d13-901e-4522-8371-269003fe656f" (UID: "c8f94d13-901e-4522-8371-269003fe656f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:17.111365 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.111359    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8f94d13-901e-4522-8371-269003fe656f-istio-podinfo" pod "c8f94d13-901e-4522-8371-269003fe656f" (UID: "c8f94d13-901e-4522-8371-269003fe656f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:05:17.211203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.211161    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59lxb\" (UniqueName: \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-kube-api-access-59lxb\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:17.211203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.211195    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8f94d13-901e-4522-8371-269003fe656f-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:17.211203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.211204    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8f94d13-901e-4522-8371-269003fe656f-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:17.211203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.211213    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8f94d13-901e-4522-8371-269003fe656f-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:17.536670 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.536585    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"
Oct 30 20:05:17.536670 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.536610    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr" event={"ID":"f54e186b-58e7-4c30-99dc-f466a32a5579","Type":"ContainerDied","Data":"fc39b287aabd17a1f274bac30c48687d0c5420a4a76ab27af1a25d8289141f5b"}
Oct 30 20:05:17.536670 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.536669    6015 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc39b287aabd17a1f274bac30c48687d0c5420a4a76ab27af1a25d8289141f5b"
Oct 30 20:05:17.538763 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.538736    6015 generic.go:356] "Generic (PLEG): container finished" podID="c8f94d13-901e-4522-8371-269003fe656f" containerID="9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba" exitCode=0
Oct 30 20:05:17.538937 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.538801    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"
Oct 30 20:05:17.538937 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.538889    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" event={"ID":"c8f94d13-901e-4522-8371-269003fe656f","Type":"ContainerDied","Data":"9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba"}
Oct 30 20:05:17.538937 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.538934    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q" event={"ID":"c8f94d13-901e-4522-8371-269003fe656f","Type":"ContainerDied","Data":"3848a66b771706af597928ad5da7e25d2810becb927666b825044524ca38d420"}
Oct 30 20:05:17.539112 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.538962    6015 scope.go:122] "RemoveContainer" containerID="9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba"
Oct 30 20:05:17.550297 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.550277    6015 scope.go:122] "RemoveContainer" containerID="e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55"
Oct 30 20:05:17.561996 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.561969    6015 scope.go:122] "RemoveContainer" containerID="9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba"
Oct 30 20:05:17.562328 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:05:17.562305    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba\": container with ID starting with 9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba not found: ID does not exist" containerID="9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba"
Oct 30 20:05:17.562415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.562339    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba"} err="failed to get container status \"9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba\": rpc error: code = NotFound desc = could not find container \"9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba\": container with ID starting with 9cd89df5be687fcf45c48d026e07ffb15aa164bf354ed3386cedeeb9c7e41cba not found: ID does not exist"
Oct 30 20:05:17.562415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.562365    6015 scope.go:122] "RemoveContainer" containerID="e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55"
Oct 30 20:05:17.562687 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:05:17.562658    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55\": container with ID starting with e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55 not found: ID does not exist" containerID="e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55"
Oct 30 20:05:17.562789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.562695    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55"} err="failed to get container status \"e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55\": rpc error: code = NotFound desc = could not find container \"e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55\": container with ID starting with e49da5c324d74e8434b13dc9981c25bedc22fe1a5ba7ad7eaee05252dc76be55 not found: ID does not exist"
Oct 30 20:05:17.705116 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.705075    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"]
Oct 30 20:05:17.715290 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:17.715247    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-a299b8-openshift-default-59d66db8cc-s425q"]
Oct 30 20:05:19.370016 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:19.369971    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:19.586374 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:19.586334    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8f94d13-901e-4522-8371-269003fe656f" path="/var/lib/kubelet/pods/c8f94d13-901e-4522-8371-269003fe656f/volumes"
Oct 30 20:05:22.498716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:22.498680    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:05:23.506449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:23.506411    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:05:24.850205 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:24.850169    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:26.474743 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:26.474695    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:28.218306 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:05:28.218264    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:05:29.757331 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:29.757283    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:30.301535 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.301496    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"]
Oct 30 20:05:30.301780 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.301739    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2" podUID="9d29fab5-72f9-4bd8-995d-a02cc241957e" containerName="payload-processing" containerID="cri-o://ad69904212655448e2e36c03637519ec3e35e2fed47b6274788120a199270b25" gracePeriod=30
Oct 30 20:05:30.358146 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.358105    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"]
Oct 30 20:05:30.358342 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.358319    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r" podUID="9e5cb63a-2b42-4ddd-93a4-869d39867d3e" containerName="payload-pre-processing" containerID="cri-o://14e4bea4cb1d72566062ad30ff425e9b52478365192a50865bdd818dc23ff207" gracePeriod=30
Oct 30 20:05:30.479463 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.479349    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:30.650259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.650212    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:30.651730 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.651705    6015 generic.go:356] "Generic (PLEG): container finished" podID="9d29fab5-72f9-4bd8-995d-a02cc241957e" containerID="ad69904212655448e2e36c03637519ec3e35e2fed47b6274788120a199270b25" exitCode=0
Oct 30 20:05:30.651962 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.651939    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2" event={"ID":"9d29fab5-72f9-4bd8-995d-a02cc241957e","Type":"ContainerDied","Data":"ad69904212655448e2e36c03637519ec3e35e2fed47b6274788120a199270b25"}
Oct 30 20:05:30.654475 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.654434    6015 generic.go:356] "Generic (PLEG): container finished" podID="9e5cb63a-2b42-4ddd-93a4-869d39867d3e" containerID="14e4bea4cb1d72566062ad30ff425e9b52478365192a50865bdd818dc23ff207" exitCode=0
Oct 30 20:05:30.654568 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.654483    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r" event={"ID":"9e5cb63a-2b42-4ddd-93a4-869d39867d3e","Type":"ContainerDied","Data":"14e4bea4cb1d72566062ad30ff425e9b52478365192a50865bdd818dc23ff207"}
Oct 30 20:05:30.684153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.684115    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:05:30.688191 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.688164    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:05:30.793434 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.793403    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d29fab5-72f9-4bd8-995d-a02cc241957e-kube-api-access-xw8vd\" (UniqueName: \"kubernetes.io/projected/9d29fab5-72f9-4bd8-995d-a02cc241957e-kube-api-access-xw8vd\") pod \"9d29fab5-72f9-4bd8-995d-a02cc241957e\" (UID: \"9d29fab5-72f9-4bd8-995d-a02cc241957e\") "
Oct 30 20:05:30.793997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.793514    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-plugins-config-volume\") pod \"9e5cb63a-2b42-4ddd-93a4-869d39867d3e\" (UID: \"9e5cb63a-2b42-4ddd-93a4-869d39867d3e\") "
Oct 30 20:05:30.793997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.793582    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d29fab5-72f9-4bd8-995d-a02cc241957e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d29fab5-72f9-4bd8-995d-a02cc241957e-plugins-config-volume\") pod \"9d29fab5-72f9-4bd8-995d-a02cc241957e\" (UID: \"9d29fab5-72f9-4bd8-995d-a02cc241957e\") "
Oct 30 20:05:30.793997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.793617    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-kube-api-access-gp82f\" (UniqueName: \"kubernetes.io/projected/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-kube-api-access-gp82f\") pod \"9e5cb63a-2b42-4ddd-93a4-869d39867d3e\" (UID: \"9e5cb63a-2b42-4ddd-93a4-869d39867d3e\") "
Oct 30 20:05:30.794175 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.794024    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-plugins-config-volume" pod "9e5cb63a-2b42-4ddd-93a4-869d39867d3e" (UID: "9e5cb63a-2b42-4ddd-93a4-869d39867d3e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:05:30.794175 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.794035    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d29fab5-72f9-4bd8-995d-a02cc241957e-plugins-config-volume" pod "9d29fab5-72f9-4bd8-995d-a02cc241957e" (UID: "9d29fab5-72f9-4bd8-995d-a02cc241957e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:05:30.794293 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.794240    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d29fab5-72f9-4bd8-995d-a02cc241957e-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:30.794293 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.794256    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:30.796577 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.796516    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d29fab5-72f9-4bd8-995d-a02cc241957e-kube-api-access-xw8vd" pod "9d29fab5-72f9-4bd8-995d-a02cc241957e" (UID: "9d29fab5-72f9-4bd8-995d-a02cc241957e"). InnerVolumeSpecName "kube-api-access-xw8vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:30.796709 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.796597    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-kube-api-access-gp82f" pod "9e5cb63a-2b42-4ddd-93a4-869d39867d3e" (UID: "9e5cb63a-2b42-4ddd-93a4-869d39867d3e"). InnerVolumeSpecName "kube-api-access-gp82f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:30.898893 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.897977    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp82f\" (UniqueName: \"kubernetes.io/projected/9e5cb63a-2b42-4ddd-93a4-869d39867d3e-kube-api-access-gp82f\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:30.898893 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:30.898032    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw8vd\" (UniqueName: \"kubernetes.io/projected/9d29fab5-72f9-4bd8-995d-a02cc241957e-kube-api-access-xw8vd\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:31.662206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:31.662176    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"
Oct 30 20:05:31.662404 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:31.662212    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r" event={"ID":"9e5cb63a-2b42-4ddd-93a4-869d39867d3e","Type":"ContainerDied","Data":"46c049b3c6b75d0516b45e313b8ef8e04e2d482f328a1a66c7312ba4be467c93"}
Oct 30 20:05:31.662404 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:31.662291    6015 scope.go:122] "RemoveContainer" containerID="14e4bea4cb1d72566062ad30ff425e9b52478365192a50865bdd818dc23ff207"
Oct 30 20:05:31.663799 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:31.663633    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"
Oct 30 20:05:31.663799 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:31.663682    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2" event={"ID":"9d29fab5-72f9-4bd8-995d-a02cc241957e","Type":"ContainerDied","Data":"e213a4b769c8e592098b6625b1793dd5ff58a7578f43d20115c8b4908dd38307"}
Oct 30 20:05:31.672736 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:31.672712    6015 scope.go:122] "RemoveContainer" containerID="ad69904212655448e2e36c03637519ec3e35e2fed47b6274788120a199270b25"
Oct 30 20:05:31.818776 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:31.818737    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"]
Oct 30 20:05:31.865696 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:31.865620    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-3f9b9b-5cd6bf9f4-4hhj2"]
Oct 30 20:05:31.926257 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:31.926212    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"]
Oct 30 20:05:31.931175 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:31.931141    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3f9b9b-d86886c47-b6m8r"]
Oct 30 20:05:31.960197 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:31.960148    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:32.241052 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:32.240963    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:32.581250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:32.581217    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:32.802445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:32.802408    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"]
Oct 30 20:05:32.849018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:32.848933    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3f9b9b-9g7lr"]
Oct 30 20:05:33.259880 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:33.259750    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:33.586953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:33.586918    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d29fab5-72f9-4bd8-995d-a02cc241957e" path="/var/lib/kubelet/pods/9d29fab5-72f9-4bd8-995d-a02cc241957e/volumes"
Oct 30 20:05:33.587391 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:33.587376    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e5cb63a-2b42-4ddd-93a4-869d39867d3e" path="/var/lib/kubelet/pods/9e5cb63a-2b42-4ddd-93a4-869d39867d3e/volumes"
Oct 30 20:05:33.587782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:33.587769    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f54e186b-58e7-4c30-99dc-f466a32a5579" path="/var/lib/kubelet/pods/f54e186b-58e7-4c30-99dc-f466a32a5579/volumes"
Oct 30 20:05:37.371445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:37.371413    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:37.714373 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:37.714273    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:39.497789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:39.497750    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:39.650884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:39.650846    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:39.822436 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:39.822403    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"]
Oct 30 20:05:39.822696 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:39.822669    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy" containerID="cri-o://9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae" gracePeriod=30
Oct 30 20:05:39.853485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:39.853445    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:40.730610 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:40.730574    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:05:40.731079 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:40.730640    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:05:42.361211 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:42.361174    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:42.543848 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:42.543790    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:42.704999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:42.704900    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.207434    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"]
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208421    6015 cpu_manager.go:414] "containerMap: removing container" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208444    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208461    6015 cpu_manager.go:414] "containerMap: removing container" podUID="9d29fab5-72f9-4bd8-995d-a02cc241957e" containerName="payload-processing"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208468    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d29fab5-72f9-4bd8-995d-a02cc241957e" containerName="payload-processing"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208521    6015 cpu_manager.go:414] "containerMap: removing container" podUID="f54e186b-58e7-4c30-99dc-f466a32a5579" containerName="revoke-keys"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208529    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f54e186b-58e7-4c30-99dc-f466a32a5579" containerName="revoke-keys"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208564    6015 cpu_manager.go:414] "containerMap: removing container" podUID="9e5cb63a-2b42-4ddd-93a4-869d39867d3e" containerName="payload-pre-processing"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208571    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e5cb63a-2b42-4ddd-93a4-869d39867d3e" containerName="payload-pre-processing"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208721    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="f54e186b-58e7-4c30-99dc-f466a32a5579" containerName="revoke-keys"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208737    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208747    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e5cb63a-2b42-4ddd-93a4-869d39867d3e" containerName="payload-pre-processing"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208761    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy"
Oct 30 20:05:43.210872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.208770    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d29fab5-72f9-4bd8-995d-a02cc241957e" containerName="payload-processing"
Oct 30 20:05:43.214919 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.214883    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.261519 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.261481    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-socket\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.261519 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.261522    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-envoy\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.261799 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.261553    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-podinfo\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.261799 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.261670    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-credential-socket\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.261799 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.261747    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-certs\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.262099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.261981    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-token\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.262099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.262027    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz9sc\" (UniqueName: \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-kube-api-access-qz9sc\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.262222 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.262128    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istiod-ca-cert\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.262222 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.262157    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-data\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.266610 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.266579    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-praxis-a-f61bae-openshift-default-dockercfg-7zpzb\""
Oct 30 20:05:43.314791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.314748    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:43.315731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.315704    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"]
Oct 30 20:05:43.363306 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.363263    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-token\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.363879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.363326    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz9sc\" (UniqueName: \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-kube-api-access-qz9sc\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.363879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.363379    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istiod-ca-cert\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.363879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.363502    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-data\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.363879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.363549    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-socket\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.363879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.363579    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-envoy\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.363879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.363626    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-podinfo\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.363879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.363675    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-credential-socket\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.363879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.363763    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-certs\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.364338 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.364231    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-certs\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.364338 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.364250    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istiod-ca-cert\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.364557 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.364493    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-credential-socket\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.364966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.364545    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-data\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.365096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.364741    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-socket\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.366617 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.366588    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-envoy\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.367079 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.367059    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-podinfo\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.424660 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.424622    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-token\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.424919 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.424896    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz9sc\" (UniqueName: \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-kube-api-access-qz9sc\") pod \"e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") " pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.538354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.538262    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:43.570342 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.570297    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:43.978460 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.978420    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"]
Oct 30 20:05:43.985089 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:05:43.984029    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3a7e3c_7e4d_4bfb_9c2c_3c76518ebd88.slice/crio-9d9d840457311e858768dec351d0233f4116a3247738de9ef5b8a1e852faf145 WatchSource:0}: Error finding container 9d9d840457311e858768dec351d0233f4116a3247738de9ef5b8a1e852faf145: Status 404 returned error can't find the container with id 9d9d840457311e858768dec351d0233f4116a3247738de9ef5b8a1e852faf145
Oct 30 20:05:43.987420 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.987382    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:05:43.987555 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.987478    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:05:43.987555 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:43.987525    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:05:44.765038 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:44.765000    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" event={"ID":"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88","Type":"ContainerStarted","Data":"b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3"}
Oct 30 20:05:44.765511 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:44.765063    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" event={"ID":"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88","Type":"ContainerStarted","Data":"9d9d840457311e858768dec351d0233f4116a3247738de9ef5b8a1e852faf145"}
Oct 30 20:05:44.790481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:44.790442    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:44.977114 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:44.977044    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" podStartSLOduration=1.9770268180000001 podStartE2EDuration="1.977026818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:05:44.927297358 +0000 UTC m=+2407.470104618" watchObservedRunningTime="2026-10-30 20:05:44.977026818 +0000 UTC m=+2407.519834082"
Oct 30 20:05:45.113063 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.113031    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:05:45.188225 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188186    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-certs\") pod \"bedde921-8b8e-485f-a7ce-ef571614f46c\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") "
Oct 30 20:05:45.188410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188234    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-token\" (UniqueName: \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-token\") pod \"bedde921-8b8e-485f-a7ce-ef571614f46c\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") "
Oct 30 20:05:45.188410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188301    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bedde921-8b8e-485f-a7ce-ef571614f46c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bedde921-8b8e-485f-a7ce-ef571614f46c-istiod-ca-cert\") pod \"bedde921-8b8e-485f-a7ce-ef571614f46c\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") "
Oct 30 20:05:45.188410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188321    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-credential-socket\") pod \"bedde921-8b8e-485f-a7ce-ef571614f46c\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") "
Oct 30 20:05:45.188410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188368    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-socket\") pod \"bedde921-8b8e-485f-a7ce-ef571614f46c\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") "
Oct 30 20:05:45.188410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188407    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-podinfo\") pod \"bedde921-8b8e-485f-a7ce-ef571614f46c\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") "
Oct 30 20:05:45.188646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188467    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-envoy\") pod \"bedde921-8b8e-485f-a7ce-ef571614f46c\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") "
Oct 30 20:05:45.188646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188528    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-certs" pod "bedde921-8b8e-485f-a7ce-ef571614f46c" (UID: "bedde921-8b8e-485f-a7ce-ef571614f46c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:45.188646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188590    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-kube-api-access-5ltvg\" (UniqueName: \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-kube-api-access-5ltvg\") pod \"bedde921-8b8e-485f-a7ce-ef571614f46c\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") "
Oct 30 20:05:45.188646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188621    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-data\") pod \"bedde921-8b8e-485f-a7ce-ef571614f46c\" (UID: \"bedde921-8b8e-485f-a7ce-ef571614f46c\") "
Oct 30 20:05:45.188886 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188762    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bedde921-8b8e-485f-a7ce-ef571614f46c-istiod-ca-cert" pod "bedde921-8b8e-485f-a7ce-ef571614f46c" (UID: "bedde921-8b8e-485f-a7ce-ef571614f46c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:05:45.188970 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.188887    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-socket" pod "bedde921-8b8e-485f-a7ce-ef571614f46c" (UID: "bedde921-8b8e-485f-a7ce-ef571614f46c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:45.189073 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.189048    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-credential-socket" pod "bedde921-8b8e-485f-a7ce-ef571614f46c" (UID: "bedde921-8b8e-485f-a7ce-ef571614f46c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:45.189152 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.189139    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-data" pod "bedde921-8b8e-485f-a7ce-ef571614f46c" (UID: "bedde921-8b8e-485f-a7ce-ef571614f46c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:45.189372 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.189253    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:45.189372 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.189271    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bedde921-8b8e-485f-a7ce-ef571614f46c-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:45.189372 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.189282    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:45.189372 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.189291    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:45.189372 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.189298    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:45.190891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.190859    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-envoy" pod "bedde921-8b8e-485f-a7ce-ef571614f46c" (UID: "bedde921-8b8e-485f-a7ce-ef571614f46c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:05:45.190891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.190879    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-podinfo" pod "bedde921-8b8e-485f-a7ce-ef571614f46c" (UID: "bedde921-8b8e-485f-a7ce-ef571614f46c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:05:45.191343 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.191323    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-token" pod "bedde921-8b8e-485f-a7ce-ef571614f46c" (UID: "bedde921-8b8e-485f-a7ce-ef571614f46c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:45.191401 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.191355    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-kube-api-access-5ltvg" pod "bedde921-8b8e-485f-a7ce-ef571614f46c" (UID: "bedde921-8b8e-485f-a7ce-ef571614f46c"). InnerVolumeSpecName "kube-api-access-5ltvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:05:45.290769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.290716    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:45.290769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.290761    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:45.290769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.290772    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bedde921-8b8e-485f-a7ce-ef571614f46c-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:45.290769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.290784    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ltvg\" (UniqueName: \"kubernetes.io/projected/bedde921-8b8e-485f-a7ce-ef571614f46c-kube-api-access-5ltvg\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:05:45.539080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.538991    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:45.545578 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.545542    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:45.773187 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.773152    6015 generic.go:356] "Generic (PLEG): container finished" podID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerID="9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae" exitCode=0
Oct 30 20:05:45.773629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.773226    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"
Oct 30 20:05:45.773629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.773239    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" event={"ID":"bedde921-8b8e-485f-a7ce-ef571614f46c","Type":"ContainerDied","Data":"9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae"}
Oct 30 20:05:45.773629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.773329    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8" event={"ID":"bedde921-8b8e-485f-a7ce-ef571614f46c","Type":"ContainerDied","Data":"328fde2965e3b69a495eaed4fb200962517051f2585bd225674ab808194ad183"}
Oct 30 20:05:45.773629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.773360    6015 scope.go:122] "RemoveContainer" containerID="9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae"
Oct 30 20:05:45.773856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.773780    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:45.774928 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.774907    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:05:45.784392 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.784371    6015 scope.go:122] "RemoveContainer" containerID="e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c"
Oct 30 20:05:45.794445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.794422    6015 scope.go:122] "RemoveContainer" containerID="9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae"
Oct 30 20:05:45.794753 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:05:45.794735    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae\": container with ID starting with 9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae not found: ID does not exist" containerID="9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae"
Oct 30 20:05:45.794801 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.794763    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae"} err="failed to get container status \"9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae\": rpc error: code = NotFound desc = could not find container \"9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae\": container with ID starting with 9018cca5997c51a519a0a788a48c82ec303eafba98dbd526d60afb2b4d6d17ae not found: ID does not exist"
Oct 30 20:05:45.794801 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.794781    6015 scope.go:122] "RemoveContainer" containerID="e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c"
Oct 30 20:05:45.795047 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:05:45.795031    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c\": container with ID starting with e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c not found: ID does not exist" containerID="e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c"
Oct 30 20:05:45.795098 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:45.795049    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c"} err="failed to get container status \"e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c\": rpc error: code = NotFound desc = could not find container \"e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c\": container with ID starting with e29f8b07d022bd8d4279626b2c82377196e5f349f24c8fdb04501e3e313b065c not found: ID does not exist"
Oct 30 20:05:46.051262 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:46.051184    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"]
Oct 30 20:05:46.058729 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:46.056386    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-3f9b9b-openshift-default-579df67bd7-dbvc8"]
Oct 30 20:05:47.589026 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:47.588983    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" path="/var/lib/kubelet/pods/bedde921-8b8e-485f-a7ce-ef571614f46c/volumes"
Oct 30 20:05:47.807703 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:47.807655    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:47.968207 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:47.968089    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:50.212229 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:50.212196    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:51.137359 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:51.137325    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:51.287664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:51.287621    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:52.520690 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:52.520658    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:55.780154 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:05:55.780117    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:05:58.217485 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:05:58.217442    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:06:01.057772 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:01.057732    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:06.192538 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:06.192495    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"]
Oct 30 20:06:06.431220 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:06.431184    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:06.639134 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:06.639100    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:06.787920 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:06.787889    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:08.489284 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:08.489244    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:11.193860 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.193774    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x" podUID="5242be24-7716-4dec-97bb-3318e84d339d" containerName="payload-processing" containerID="cri-o://642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a" gracePeriod=25
Oct 30 20:06:11.474919 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.474867    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:06:11.558169 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.558133    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5242be24-7716-4dec-97bb-3318e84d339d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5242be24-7716-4dec-97bb-3318e84d339d-plugins-config-volume\") pod \"5242be24-7716-4dec-97bb-3318e84d339d\" (UID: \"5242be24-7716-4dec-97bb-3318e84d339d\") "
Oct 30 20:06:11.558392 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.558258    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5242be24-7716-4dec-97bb-3318e84d339d-kube-api-access-zktmj\" (UniqueName: \"kubernetes.io/projected/5242be24-7716-4dec-97bb-3318e84d339d-kube-api-access-zktmj\") pod \"5242be24-7716-4dec-97bb-3318e84d339d\" (UID: \"5242be24-7716-4dec-97bb-3318e84d339d\") "
Oct 30 20:06:11.558530 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.558506    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5242be24-7716-4dec-97bb-3318e84d339d-plugins-config-volume" pod "5242be24-7716-4dec-97bb-3318e84d339d" (UID: "5242be24-7716-4dec-97bb-3318e84d339d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:06:11.558917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.558898    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5242be24-7716-4dec-97bb-3318e84d339d-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:11.560718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.560691    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5242be24-7716-4dec-97bb-3318e84d339d-kube-api-access-zktmj" pod "5242be24-7716-4dec-97bb-3318e84d339d" (UID: "5242be24-7716-4dec-97bb-3318e84d339d"). InnerVolumeSpecName "kube-api-access-zktmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:11.660548 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.660506    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zktmj\" (UniqueName: \"kubernetes.io/projected/5242be24-7716-4dec-97bb-3318e84d339d-kube-api-access-zktmj\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:11.954770 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.954733    6015 generic.go:356] "Generic (PLEG): container finished" podID="5242be24-7716-4dec-97bb-3318e84d339d" containerID="642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a" exitCode=0
Oct 30 20:06:11.954968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.954782    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"
Oct 30 20:06:11.954968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.954831    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x" event={"ID":"5242be24-7716-4dec-97bb-3318e84d339d","Type":"ContainerDied","Data":"642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a"}
Oct 30 20:06:11.954968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.954886    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x" event={"ID":"5242be24-7716-4dec-97bb-3318e84d339d","Type":"ContainerDied","Data":"7750117ee09a237c58e7bda45a4674bbbabad60083cbd3eeb0bbe43bc915b432"}
Oct 30 20:06:11.954968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.954908    6015 scope.go:122] "RemoveContainer" containerID="642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a"
Oct 30 20:06:11.964700 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.964676    6015 scope.go:122] "RemoveContainer" containerID="642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a"
Oct 30 20:06:11.965076 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:06:11.965048    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a\": container with ID starting with 642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a not found: ID does not exist" containerID="642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a"
Oct 30 20:06:11.965188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:11.965083    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a"} err="failed to get container status \"642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a\": rpc error: code = NotFound desc = could not find container \"642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a\": container with ID starting with 642064ef1a5fe6871f5a1c0cd97fe1ec83cf4d9cc8f94bfabe926ef36e757a4a not found: ID does not exist"
Oct 30 20:06:12.111716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:12.111686    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"]
Oct 30 20:06:12.114038 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:12.114008    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-69dcf9c86b-p4f4x"]
Oct 30 20:06:13.587070 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:13.587028    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5242be24-7716-4dec-97bb-3318e84d339d" path="/var/lib/kubelet/pods/5242be24-7716-4dec-97bb-3318e84d339d/volumes"
Oct 30 20:06:13.601268 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:13.601231    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:18.027128 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.027040    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:18.405704 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.405664    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"]
Oct 30 20:06:18.405949 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.405908    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8" podUID="284a9a1a-2093-4dc4-9ffd-b4a77d0d1261" containerName="payload-processing" containerID="cri-o://bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3" gracePeriod=30
Oct 30 20:06:18.510946 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.510909    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"]
Oct 30 20:06:18.511433 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.511371    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr" podUID="ed97e0f8-4158-4b7c-9cee-77e9dd6fab93" containerName="payload-pre-processing" containerID="cri-o://04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc" gracePeriod=30
Oct 30 20:06:18.619343 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.617525    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:18.808586 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.808275    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:18.815746 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.815717    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:06:18.855232 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.855194    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-plugins-config-volume\") pod \"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261\" (UID: \"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261\") "
Oct 30 20:06:18.855477 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.855457    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-kube-api-access-m92x2\" (UniqueName: \"kubernetes.io/projected/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-kube-api-access-m92x2\") pod \"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261\" (UID: \"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261\") "
Oct 30 20:06:18.856583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.856508    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-plugins-config-volume" pod "284a9a1a-2093-4dc4-9ffd-b4a77d0d1261" (UID: "284a9a1a-2093-4dc4-9ffd-b4a77d0d1261"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:06:18.860339 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.860309    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-kube-api-access-m92x2" pod "284a9a1a-2093-4dc4-9ffd-b4a77d0d1261" (UID: "284a9a1a-2093-4dc4-9ffd-b4a77d0d1261"). InnerVolumeSpecName "kube-api-access-m92x2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:18.921431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.921405    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:06:18.956829 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.956769    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-kube-api-access-gvzjr\" (UniqueName: \"kubernetes.io/projected/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-kube-api-access-gvzjr\") pod \"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93\" (UID: \"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93\") "
Oct 30 20:06:18.957186 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.957157    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-plugins-config-volume\") pod \"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93\" (UID: \"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93\") "
Oct 30 20:06:18.957636 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.957611    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-plugins-config-volume" pod "ed97e0f8-4158-4b7c-9cee-77e9dd6fab93" (UID: "ed97e0f8-4158-4b7c-9cee-77e9dd6fab93"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:06:18.957875 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.957854    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:18.957950 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.957887    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m92x2\" (UniqueName: \"kubernetes.io/projected/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-kube-api-access-m92x2\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:18.957950 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.957905    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:18.960699 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:18.960633    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-kube-api-access-gvzjr" pod "ed97e0f8-4158-4b7c-9cee-77e9dd6fab93" (UID: "ed97e0f8-4158-4b7c-9cee-77e9dd6fab93"). InnerVolumeSpecName "kube-api-access-gvzjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:19.058387 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.058345    6015 generic.go:356] "Generic (PLEG): container finished" podID="ed97e0f8-4158-4b7c-9cee-77e9dd6fab93" containerID="04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc" exitCode=0
Oct 30 20:06:19.058906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.058516    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr" event={"ID":"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93","Type":"ContainerDied","Data":"04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc"}
Oct 30 20:06:19.058906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.058601    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr" event={"ID":"ed97e0f8-4158-4b7c-9cee-77e9dd6fab93","Type":"ContainerDied","Data":"06183d86f58466f763136fd8168fa1a2d2b69c400394c36d14314ebdfe9e18ab"}
Oct 30 20:06:19.058906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.058630    6015 scope.go:122] "RemoveContainer" containerID="04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc"
Oct 30 20:06:19.058906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.058789    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"
Oct 30 20:06:19.063972 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.063941    6015 generic.go:356] "Generic (PLEG): container finished" podID="284a9a1a-2093-4dc4-9ffd-b4a77d0d1261" containerID="bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3" exitCode=0
Oct 30 20:06:19.064321 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.064269    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8" event={"ID":"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261","Type":"ContainerDied","Data":"bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3"}
Oct 30 20:06:19.064493 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.064476    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8" event={"ID":"284a9a1a-2093-4dc4-9ffd-b4a77d0d1261","Type":"ContainerDied","Data":"300d1baaf1bde13863b5595d5eb2ecb6dcab3b75123ce0abb391263ab490f994"}
Oct 30 20:06:19.064711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.064696    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"
Oct 30 20:06:19.073133 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.073095    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvzjr\" (UniqueName: \"kubernetes.io/projected/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93-kube-api-access-gvzjr\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:19.126781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.126760    6015 scope.go:122] "RemoveContainer" containerID="04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc"
Oct 30 20:06:19.127144 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:06:19.127123    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc\": container with ID starting with 04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc not found: ID does not exist" containerID="04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc"
Oct 30 20:06:19.127212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.127156    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc"} err="failed to get container status \"04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc\": rpc error: code = NotFound desc = could not find container \"04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc\": container with ID starting with 04e8cb21535832693961bb2f55f86e822d4b9cffe177823355cbbb4d092c7bcc not found: ID does not exist"
Oct 30 20:06:19.127212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.127176    6015 scope.go:122] "RemoveContainer" containerID="bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3"
Oct 30 20:06:19.138273 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.138259    6015 scope.go:122] "RemoveContainer" containerID="bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3"
Oct 30 20:06:19.138617 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:06:19.138593    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3\": container with ID starting with bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3 not found: ID does not exist" containerID="bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3"
Oct 30 20:06:19.138671 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.138626    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3"} err="failed to get container status \"bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3\": rpc error: code = NotFound desc = could not find container \"bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3\": container with ID starting with bae0e1103dd0e3ac96029a4e5ac33698a80ec007ecaad884cbbd3c3480cc9fd3 not found: ID does not exist"
Oct 30 20:06:19.311093 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.308122    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"]
Oct 30 20:06:19.312640 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.312613    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-77a92c-b99f9447-4mdbr"]
Oct 30 20:06:19.388834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.378167    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:19.416149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.416115    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"]
Oct 30 20:06:19.421968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.421924    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-77a92c-8b4fdbc54-k4wd8"]
Oct 30 20:06:19.594880 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.594587    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="284a9a1a-2093-4dc4-9ffd-b4a77d0d1261" path="/var/lib/kubelet/pods/284a9a1a-2093-4dc4-9ffd-b4a77d0d1261/volumes"
Oct 30 20:06:19.600829 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.599403    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ed97e0f8-4158-4b7c-9cee-77e9dd6fab93" path="/var/lib/kubelet/pods/ed97e0f8-4158-4b7c-9cee-77e9dd6fab93/volumes"
Oct 30 20:06:19.747453 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.747411    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"]
Oct 30 20:06:19.747651 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.747620    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr" podUID="e76515be-1a41-4328-860f-9e6ef65cb26e" containerName="payload-processing" containerID="cri-o://2b6fa42fb6c1417963465dc691d593b0fff8c72ff0713183ba721acbcb701230" gracePeriod=30
Oct 30 20:06:19.757348 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:19.757315    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:20.037620 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.037451    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:20.105740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.105684    6015 generic.go:356] "Generic (PLEG): container finished" podID="e76515be-1a41-4328-860f-9e6ef65cb26e" containerID="2b6fa42fb6c1417963465dc691d593b0fff8c72ff0713183ba721acbcb701230" exitCode=0
Oct 30 20:06:20.107473 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.107365    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr" event={"ID":"e76515be-1a41-4328-860f-9e6ef65cb26e","Type":"ContainerDied","Data":"2b6fa42fb6c1417963465dc691d593b0fff8c72ff0713183ba721acbcb701230"}
Oct 30 20:06:20.152920 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.152891    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:06:20.196497 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.196459    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:20.222016 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.221983    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e76515be-1a41-4328-860f-9e6ef65cb26e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e76515be-1a41-4328-860f-9e6ef65cb26e-plugins-config-volume\") pod \"e76515be-1a41-4328-860f-9e6ef65cb26e\" (UID: \"e76515be-1a41-4328-860f-9e6ef65cb26e\") "
Oct 30 20:06:20.222167 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.222117    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e76515be-1a41-4328-860f-9e6ef65cb26e-kube-api-access-b9sbp\" (UniqueName: \"kubernetes.io/projected/e76515be-1a41-4328-860f-9e6ef65cb26e-kube-api-access-b9sbp\") pod \"e76515be-1a41-4328-860f-9e6ef65cb26e\" (UID: \"e76515be-1a41-4328-860f-9e6ef65cb26e\") "
Oct 30 20:06:20.222354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.222330    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e76515be-1a41-4328-860f-9e6ef65cb26e-plugins-config-volume" pod "e76515be-1a41-4328-860f-9e6ef65cb26e" (UID: "e76515be-1a41-4328-860f-9e6ef65cb26e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:06:20.222540 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.222526    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e76515be-1a41-4328-860f-9e6ef65cb26e-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:20.224521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.224493    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e76515be-1a41-4328-860f-9e6ef65cb26e-kube-api-access-b9sbp" pod "e76515be-1a41-4328-860f-9e6ef65cb26e" (UID: "e76515be-1a41-4328-860f-9e6ef65cb26e"). InnerVolumeSpecName "kube-api-access-b9sbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:20.324163 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.324106    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9sbp\" (UniqueName: \"kubernetes.io/projected/e76515be-1a41-4328-860f-9e6ef65cb26e-kube-api-access-b9sbp\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:20.838476 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:20.838441    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:21.116281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:21.116206    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"
Oct 30 20:06:21.116281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:21.116247    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr" event={"ID":"e76515be-1a41-4328-860f-9e6ef65cb26e","Type":"ContainerDied","Data":"fe2ba09487977c218c5fbae922788541215546203cec69ea9afdb8a3b0ff608a"}
Oct 30 20:06:21.116762 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:21.116310    6015 scope.go:122] "RemoveContainer" containerID="2b6fa42fb6c1417963465dc691d593b0fff8c72ff0713183ba721acbcb701230"
Oct 30 20:06:21.192058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:21.192022    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:21.296348 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:21.296316    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"]
Oct 30 20:06:21.342242 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:21.342199    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-8b0edc-7d86fc8d9b-9d6fr"]
Oct 30 20:06:21.486668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:21.486514    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:21.600388 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:21.600343    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e76515be-1a41-4328-860f-9e6ef65cb26e" path="/var/lib/kubelet/pods/e76515be-1a41-4328-860f-9e6ef65cb26e/volumes"
Oct 30 20:06:21.634386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:21.634350    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:22.181414 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:22.181374    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:26.945939 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:26.945870    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:27.804037 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:27.804002    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:27.982038 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:27.982003    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:28.151277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:28.151191    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"]
Oct 30 20:06:28.151429 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:28.151409    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy" containerID="cri-o://ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3" gracePeriod=30
Oct 30 20:06:28.174887 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:28.174850    6015 generic.go:356] "Generic (PLEG): container finished" podID="931bf764-99e5-43a7-af49-a994ac30a68a" containerID="0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41" exitCode=0
Oct 30 20:06:28.175059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:28.174931    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" event={"ID":"931bf764-99e5-43a7-af49-a994ac30a68a","Type":"ContainerDied","Data":"0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41"}
Oct 30 20:06:28.175443 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:28.175426    6015 scope.go:122] "RemoveContainer" containerID="0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41"
Oct 30 20:06:28.176854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:28.176823    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:06:28.176966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:28.176910    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:06:28.176966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:28.176960    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:06:28.217617 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:06:28.217565    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:06:28.235099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:28.235066    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:28.877866 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:28.877770    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:29.035257 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:29.035219    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:29.227775 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:29.227688    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:29.229505 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:29.229477    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" event={"ID":"931bf764-99e5-43a7-af49-a994ac30a68a","Type":"ContainerStarted","Data":"ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a"}
Oct 30 20:06:29.619439 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:29.619396    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:06:29.619648 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:29.619464    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:06:29.650082 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:29.650054    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:06:29.650282 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:29.650184    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:06:29.650282 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:29.650226    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused"
Oct 30 20:06:29.698279 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:29.698219    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:30.529585 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:30.529545    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:30.650741 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:30.650702    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:06:30.650978 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:30.650764    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused"
Oct 30 20:06:30.712085 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:30.712034    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:30.887772 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:30.887735    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:31.485447 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:31.485409    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:31.650105 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:31.650048    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:06:31.650553 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:31.650131    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused"
Oct 30 20:06:31.729398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:31.729340    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:32.102557 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:32.102516    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:32.650771 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:32.650731    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:06:32.651217 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:32.650799    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused"
Oct 30 20:06:33.521375 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.521335    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:06:33.592738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.592693    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-podinfo\") pod \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") "
Oct 30 20:06:33.593492 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.593465    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-kube-api-access-tqb7z\" (UniqueName: \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-kube-api-access-tqb7z\") pod \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") "
Oct 30 20:06:33.600871 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.598525    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-kube-api-access-tqb7z" pod "96a6c8f6-c1b1-4622-a9e3-86766dc96e97" (UID: "96a6c8f6-c1b1-4622-a9e3-86766dc96e97"). InnerVolumeSpecName "kube-api-access-tqb7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:33.601472 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.600750    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-podinfo" pod "96a6c8f6-c1b1-4622-a9e3-86766dc96e97" (UID: "96a6c8f6-c1b1-4622-a9e3-86766dc96e97"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:06:33.601638 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.601129    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-envoy\") pod \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") "
Oct 30 20:06:33.601800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.601784    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istiod-ca-cert\") pod \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") "
Oct 30 20:06:33.602347 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.602330    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-certs\") pod \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") "
Oct 30 20:06:33.602849 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.602208    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istiod-ca-cert" pod "96a6c8f6-c1b1-4622-a9e3-86766dc96e97" (UID: "96a6c8f6-c1b1-4622-a9e3-86766dc96e97"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:06:33.602849 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.602676    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-certs" pod "96a6c8f6-c1b1-4622-a9e3-86766dc96e97" (UID: "96a6c8f6-c1b1-4622-a9e3-86766dc96e97"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:06:33.606521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.606488    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-envoy" pod "96a6c8f6-c1b1-4622-a9e3-86766dc96e97" (UID: "96a6c8f6-c1b1-4622-a9e3-86766dc96e97"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:06:33.606783 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.606747    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-credential-socket\") pod \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") "
Oct 30 20:06:33.607002 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.606967    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-data\") pod \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") "
Oct 30 20:06:33.607227 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.607121    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-credential-socket" pod "96a6c8f6-c1b1-4622-a9e3-86766dc96e97" (UID: "96a6c8f6-c1b1-4622-a9e3-86766dc96e97"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:06:33.607227 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.607183    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-socket\") pod \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") "
Oct 30 20:06:33.607227 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.607223    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-data" pod "96a6c8f6-c1b1-4622-a9e3-86766dc96e97" (UID: "96a6c8f6-c1b1-4622-a9e3-86766dc96e97"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:06:33.607476 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.607278    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-token\" (UniqueName: \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-token\") pod \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\" (UID: \"96a6c8f6-c1b1-4622-a9e3-86766dc96e97\") "
Oct 30 20:06:33.607476 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.607442    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-socket" pod "96a6c8f6-c1b1-4622-a9e3-86766dc96e97" (UID: "96a6c8f6-c1b1-4622-a9e3-86766dc96e97"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:06:33.608023 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.607998    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:33.608099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.608028    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:33.608099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.608042    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:33.608099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.608056    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:33.608099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.608070    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqb7z\" (UniqueName: \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-kube-api-access-tqb7z\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:33.608099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.608084    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:33.608269 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.608098    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:33.608269 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.608111    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:33.610019 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.609992    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-token" pod "96a6c8f6-c1b1-4622-a9e3-86766dc96e97" (UID: "96a6c8f6-c1b1-4622-a9e3-86766dc96e97"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:06:33.650490 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.650458    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:06:33.650642 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.650515    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused"
Oct 30 20:06:33.710128 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:33.710085    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96a6c8f6-c1b1-4622-a9e3-86766dc96e97-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:06:34.299679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.299467    6015 generic.go:356] "Generic (PLEG): container finished" podID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerID="ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3" exitCode=0
Oct 30 20:06:34.299679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.299517    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" event={"ID":"96a6c8f6-c1b1-4622-a9e3-86766dc96e97","Type":"ContainerDied","Data":"ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3"}
Oct 30 20:06:34.299679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.299556    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"
Oct 30 20:06:34.299679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.299596    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2" event={"ID":"96a6c8f6-c1b1-4622-a9e3-86766dc96e97","Type":"ContainerDied","Data":"14da8c317937dfb7c11363860003e4791c4a973394c453357452f86043222319"}
Oct 30 20:06:34.299679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.299628    6015 scope.go:122] "RemoveContainer" containerID="ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3"
Oct 30 20:06:34.312864 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.312840    6015 scope.go:122] "RemoveContainer" containerID="034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a"
Oct 30 20:06:34.323644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.323618    6015 scope.go:122] "RemoveContainer" containerID="ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3"
Oct 30 20:06:34.323984 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:06:34.323962    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3\": container with ID starting with ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3 not found: ID does not exist" containerID="ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3"
Oct 30 20:06:34.324070 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.323998    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3"} err="failed to get container status \"ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3\": rpc error: code = NotFound desc = could not find container \"ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3\": container with ID starting with ea02a4a98a95f33c7f4b3aace03beeb98e320f4619f5462fe6e24915ef2699e3 not found: ID does not exist"
Oct 30 20:06:34.324070 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.324026    6015 scope.go:122] "RemoveContainer" containerID="034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a"
Oct 30 20:06:34.324325 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:06:34.324305    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a\": container with ID starting with 034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a not found: ID does not exist" containerID="034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a"
Oct 30 20:06:34.324361 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.324334    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a"} err="failed to get container status \"034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a\": rpc error: code = NotFound desc = could not find container \"034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a\": container with ID starting with 034167c82e25584df6dec8f5cdbe6156693217ee966e967ff0251cda5b45514a not found: ID does not exist"
Oct 30 20:06:34.456841 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.456792    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"]
Oct 30 20:06:34.506064 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.506013    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-77a92c-openshift-default-68f8fb874c-2c6z2"]
Oct 30 20:06:34.650135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.650008    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused" start-of-body=
Oct 30 20:06:34.650135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.650066    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.108:15021/healthz/ready\": dial tcp 10.134.0.108:15021: connect: connection refused"
Oct 30 20:06:34.919191 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:34.919101    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:35.094639 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:35.094599    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:35.244780 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:35.244679    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:35.587095 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:35.587060    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" path="/var/lib/kubelet/pods/96a6c8f6-c1b1-4622-a9e3-86766dc96e97/volumes"
Oct 30 20:06:35.655612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:35.655582    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:06:35.655894 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:35.655868    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:06:35.656718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:35.656695    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:06:35.888531 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:35.888444    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:36.096125 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:36.096075    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:37.648039 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:37.648002    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:38.240976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:38.240936    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:38.434885 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:38.434847    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:43.245766 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:43.245715    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:43.429406 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:43.429369    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:45.139558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:45.139522    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:50.157668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:50.157627    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:50.327567 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:50.327534    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:50.494153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:50.494052    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:52.880816 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:52.880757    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:55.406783 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:06:55.406739    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:06:58.217393 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:06:58.217357    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:07:00.784031 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:00.783991    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:04.623780 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:04.623694    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:05.170438 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:05.170395    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:06.259606 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.259566    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"]
Oct 30 20:07:06.260166 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260149    6015 cpu_manager.go:414] "containerMap: removing container" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy"
Oct 30 20:07:06.260166 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260166    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260178    6015 cpu_manager.go:414] "containerMap: removing container" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260185    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260198    6015 cpu_manager.go:414] "containerMap: removing container" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260203    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260212    6015 cpu_manager.go:414] "containerMap: removing container" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260217    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260235    6015 cpu_manager.go:414] "containerMap: removing container" podUID="ed97e0f8-4158-4b7c-9cee-77e9dd6fab93" containerName="payload-pre-processing"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260240    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ed97e0f8-4158-4b7c-9cee-77e9dd6fab93" containerName="payload-pre-processing"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260248    6015 cpu_manager.go:414] "containerMap: removing container" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260253    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8f94d13-901e-4522-8371-269003fe656f" containerName="istio-proxy"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260260    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5242be24-7716-4dec-97bb-3318e84d339d" containerName="payload-processing"
Oct 30 20:07:06.260261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260265    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5242be24-7716-4dec-97bb-3318e84d339d" containerName="payload-processing"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260276    6015 cpu_manager.go:414] "containerMap: removing container" podUID="e76515be-1a41-4328-860f-9e6ef65cb26e" containerName="payload-processing"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260281    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e76515be-1a41-4328-860f-9e6ef65cb26e" containerName="payload-processing"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260294    6015 cpu_manager.go:414] "containerMap: removing container" podUID="284a9a1a-2093-4dc4-9ffd-b4a77d0d1261" containerName="payload-processing"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260298    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="284a9a1a-2093-4dc4-9ffd-b4a77d0d1261" containerName="payload-processing"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260399    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="ed97e0f8-4158-4b7c-9cee-77e9dd6fab93" containerName="payload-pre-processing"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260408    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5242be24-7716-4dec-97bb-3318e84d339d" containerName="payload-processing"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260415    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="e76515be-1a41-4328-860f-9e6ef65cb26e" containerName="payload-processing"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260424    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="284a9a1a-2093-4dc4-9ffd-b4a77d0d1261" containerName="payload-processing"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260432    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260437    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="96a6c8f6-c1b1-4622-a9e3-86766dc96e97" containerName="istio-proxy"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260443    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy"
Oct 30 20:07:06.260630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.260449    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="bedde921-8b8e-485f-a7ce-ef571614f46c" containerName="istio-proxy"
Oct 30 20:07:06.277189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.277153    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:07:06.319789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.319759    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"]
Oct 30 20:07:06.332370 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.332324    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbvm9\" (UniqueName: \"kubernetes.io/projected/d384d99a-2ed0-4867-acd8-8881424785c7-kube-api-access-pbvm9\") pod \"payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s\" (UID: \"d384d99a-2ed0-4867-acd8-8881424785c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:07:06.332561 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.332449    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d384d99a-2ed0-4867-acd8-8881424785c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s\" (UID: \"d384d99a-2ed0-4867-acd8-8881424785c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:07:06.363410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.363376    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-c60685\""
Oct 30 20:07:06.363580 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.363456    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-c60685-dockercfg-7pldw\""
Oct 30 20:07:06.433623 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.433581    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbvm9\" (UniqueName: \"kubernetes.io/projected/d384d99a-2ed0-4867-acd8-8881424785c7-kube-api-access-pbvm9\") pod \"payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s\" (UID: \"d384d99a-2ed0-4867-acd8-8881424785c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:07:06.433861 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.433651    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d384d99a-2ed0-4867-acd8-8881424785c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s\" (UID: \"d384d99a-2ed0-4867-acd8-8881424785c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:07:06.434395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.434371    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d384d99a-2ed0-4867-acd8-8881424785c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s\" (UID: \"d384d99a-2ed0-4867-acd8-8881424785c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:07:06.493459 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.493425    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbvm9\" (UniqueName: \"kubernetes.io/projected/d384d99a-2ed0-4867-acd8-8881424785c7-kube-api-access-pbvm9\") pod \"payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s\" (UID: \"d384d99a-2ed0-4867-acd8-8881424785c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:07:06.611970 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.611936    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:07:06.980892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.979044    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"]
Oct 30 20:07:06.995378 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:06.995348    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:07:07.007917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.007884    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"]
Oct 30 20:07:07.012712 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:07:07.012683    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd384d99a_2ed0_4867_acd8_8881424785c7.slice/crio-8ce378f42e60d7ba4893df99d7d76335ff40188e687eeb9dcafe736ce8dad659 WatchSource:0}: Error finding container 8ce378f42e60d7ba4893df99d7d76335ff40188e687eeb9dcafe736ce8dad659: Status 404 returned error can't find the container with id 8ce378f42e60d7ba4893df99d7d76335ff40188e687eeb9dcafe736ce8dad659
Oct 30 20:07:07.033100 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.033063    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"]
Oct 30 20:07:07.041772 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.041734    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp\" (UID: \"50b86726-1ec5-4ad0-9b6e-9e12b6718eec\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:07:07.041944 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.041874    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4vz2\" (UniqueName: \"kubernetes.io/projected/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-kube-api-access-r4vz2\") pod \"payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp\" (UID: \"50b86726-1ec5-4ad0-9b6e-9e12b6718eec\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:07:07.142843 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.142794    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4vz2\" (UniqueName: \"kubernetes.io/projected/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-kube-api-access-r4vz2\") pod \"payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp\" (UID: \"50b86726-1ec5-4ad0-9b6e-9e12b6718eec\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:07:07.143055 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.143039    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp\" (UID: \"50b86726-1ec5-4ad0-9b6e-9e12b6718eec\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:07:07.143733 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.143713    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp\" (UID: \"50b86726-1ec5-4ad0-9b6e-9e12b6718eec\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:07:07.209738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.209701    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4vz2\" (UniqueName: \"kubernetes.io/projected/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-kube-api-access-r4vz2\") pod \"payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp\" (UID: \"50b86726-1ec5-4ad0-9b6e-9e12b6718eec\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:07:07.295831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.295445    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:07.312004 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.311968    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:07:07.528600 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.528484    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s" event={"ID":"d384d99a-2ed0-4867-acd8-8881424785c7","Type":"ContainerStarted","Data":"4d5b9b91b1f904f8038588d7df34b6421e46000b78fef9971c198064fb590837"}
Oct 30 20:07:07.528600 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.528546    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s" event={"ID":"d384d99a-2ed0-4867-acd8-8881424785c7","Type":"ContainerStarted","Data":"8ce378f42e60d7ba4893df99d7d76335ff40188e687eeb9dcafe736ce8dad659"}
Oct 30 20:07:07.528600 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.528574    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:07:07.657838 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.657692    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s" podStartSLOduration=1.6576734709999998 podStartE2EDuration="1.657673471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:07:07.655252699 +0000 UTC m=+2490.198059963" watchObservedRunningTime="2026-10-30 20:07:07.657673471 +0000 UTC m=+2490.200480737"
Oct 30 20:07:07.823582 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.823552    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"]
Oct 30 20:07:07.838342 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:07.835247    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:08.038089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:08.038054    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:08.538089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:08.538053    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp" event={"ID":"50b86726-1ec5-4ad0-9b6e-9e12b6718eec","Type":"ContainerStarted","Data":"20a62942e5947599f23b2fd9805f24b549553def342f1ef5e3878c768beb8816"}
Oct 30 20:07:08.538698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:08.538673    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp" event={"ID":"50b86726-1ec5-4ad0-9b6e-9e12b6718eec","Type":"ContainerStarted","Data":"6fed3739f234d14fb6d24dd02febba74b625e565b48f99cf12bd5d19283540f9"}
Oct 30 20:07:08.538887 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:08.538875    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:07:08.656668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:08.656608    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp" podStartSLOduration=2.6565906679999998 podStartE2EDuration="2.656590668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:07:08.65490906 +0000 UTC m=+2491.197716328" watchObservedRunningTime="2026-10-30 20:07:08.656590668 +0000 UTC m=+2491.199397934"
Oct 30 20:07:09.216411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:09.216335    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:09.525413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:09.524134    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:09.828532 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:09.828420    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:10.493417 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:10.493380    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:14.584981 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:14.584945    6015 generic.go:356] "Generic (PLEG): container finished" podID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerID="b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3" exitCode=0
Oct 30 20:07:14.585533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:14.585024    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" event={"ID":"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88","Type":"ContainerDied","Data":"b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3"}
Oct 30 20:07:14.585533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:14.585441    6015 scope.go:122] "RemoveContainer" containerID="b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3"
Oct 30 20:07:14.587198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:14.587167    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:07:14.587297 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:14.587254    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:07:14.587340 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:14.587296    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:07:14.752680 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:14.752585    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:15.601699 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:15.601662    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" event={"ID":"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88","Type":"ContainerStarted","Data":"118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2"}
Oct 30 20:07:15.774013 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:15.773978    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:07:16.538797 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:16.538747    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:07:16.540240 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:16.540216    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused" start-of-body=
Oct 30 20:07:16.540390 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:16.540266    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused"
Oct 30 20:07:17.280500 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:17.280461    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:17.456600 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:17.456547    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:17.539282 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:17.539189    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused" start-of-body=
Oct 30 20:07:17.539282 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:17.539247    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused"
Oct 30 20:07:17.664521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:17.664480    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:18.538869 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:18.538826    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused" start-of-body=
Oct 30 20:07:18.539311 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:18.538890    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused"
Oct 30 20:07:18.540564 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:18.540538    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:07:19.538909 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:19.538864    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused" start-of-body=
Oct 30 20:07:19.539432 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:19.538931    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused"
Oct 30 20:07:20.146490 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:20.146450    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:20.538986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:20.538891    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused" start-of-body=
Oct 30 20:07:20.538986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:20.538967    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.118:15021/healthz/ready\": dial tcp 10.134.0.118:15021: connect: connection refused"
Oct 30 20:07:20.554153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:20.554121    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:07:21.543606 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:21.543570    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:07:21.544742 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:21.544725    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:07:25.175049 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:25.175012    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:28.220458 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:07:28.220419    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:07:28.245656 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:28.245623    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp_50b86726-1ec5-4ad0-9b6e-9e12b6718eec/payload-processing/0.log"
Oct 30 20:07:30.033034 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:30.032993    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"]
Oct 30 20:07:30.214392 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:30.214351    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:30.447271 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:30.447224    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:30.611326 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:30.611274    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:33.207238 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:33.207202    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:35.034143 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.034092    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf" podUID="fb24b90e-8a67-4504-95dd-1af78f642318" containerName="payload-processing" containerID="cri-o://7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13" gracePeriod=25
Oct 30 20:07:35.145346 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.145314    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:35.304532 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.304497    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:35.311144 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.311119    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:07:35.378933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.378899    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb24b90e-8a67-4504-95dd-1af78f642318-kube-api-access-bjk94\" (UniqueName: \"kubernetes.io/projected/fb24b90e-8a67-4504-95dd-1af78f642318-kube-api-access-bjk94\") pod \"fb24b90e-8a67-4504-95dd-1af78f642318\" (UID: \"fb24b90e-8a67-4504-95dd-1af78f642318\") "
Oct 30 20:07:35.379138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.378957    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb24b90e-8a67-4504-95dd-1af78f642318-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb24b90e-8a67-4504-95dd-1af78f642318-plugins-config-volume\") pod \"fb24b90e-8a67-4504-95dd-1af78f642318\" (UID: \"fb24b90e-8a67-4504-95dd-1af78f642318\") "
Oct 30 20:07:35.379435 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.379405    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb24b90e-8a67-4504-95dd-1af78f642318-plugins-config-volume" pod "fb24b90e-8a67-4504-95dd-1af78f642318" (UID: "fb24b90e-8a67-4504-95dd-1af78f642318"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:07:35.381762 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.381724    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb24b90e-8a67-4504-95dd-1af78f642318-kube-api-access-bjk94" pod "fb24b90e-8a67-4504-95dd-1af78f642318" (UID: "fb24b90e-8a67-4504-95dd-1af78f642318"). InnerVolumeSpecName "kube-api-access-bjk94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:07:35.459278 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.459245    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:35.480594 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.480556    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjk94\" (UniqueName: \"kubernetes.io/projected/fb24b90e-8a67-4504-95dd-1af78f642318-kube-api-access-bjk94\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:07:35.480594 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.480591    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb24b90e-8a67-4504-95dd-1af78f642318-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:07:35.762974 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.762936    6015 generic.go:356] "Generic (PLEG): container finished" podID="fb24b90e-8a67-4504-95dd-1af78f642318" containerID="7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13" exitCode=0
Oct 30 20:07:35.763159 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.762996    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"
Oct 30 20:07:35.763159 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.763005    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf" event={"ID":"fb24b90e-8a67-4504-95dd-1af78f642318","Type":"ContainerDied","Data":"7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13"}
Oct 30 20:07:35.763159 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.763049    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf" event={"ID":"fb24b90e-8a67-4504-95dd-1af78f642318","Type":"ContainerDied","Data":"c3adbc6d5df5362ae853ee6d80fee2d58a7993016dc57417a06a5ad9adaa41d8"}
Oct 30 20:07:35.763159 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.763070    6015 scope.go:122] "RemoveContainer" containerID="7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13"
Oct 30 20:07:35.773106 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.773083    6015 scope.go:122] "RemoveContainer" containerID="7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13"
Oct 30 20:07:35.773408 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:07:35.773380    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13\": container with ID starting with 7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13 not found: ID does not exist" containerID="7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13"
Oct 30 20:07:35.773483 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.773418    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13"} err="failed to get container status \"7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13\": rpc error: code = NotFound desc = could not find container \"7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13\": container with ID starting with 7e1d4f86058217d11fdc00c81804f6d74b358c0913e3cefa8f22ca52b8f18f13 not found: ID does not exist"
Oct 30 20:07:35.921623 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.921532    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"]
Oct 30 20:07:35.968066 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:35.968016    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-f700fe-7bcf4b647d-6k4zf"]
Oct 30 20:07:37.586591 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:37.586558    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb24b90e-8a67-4504-95dd-1af78f642318" path="/var/lib/kubelet/pods/fb24b90e-8a67-4504-95dd-1af78f642318/volumes"
Oct 30 20:07:40.256137 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:40.256094    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:40.441366 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:40.441320    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:40.614721 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:40.614681    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:45.698896 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:45.698854    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:52.619214 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:52.619176    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:53.304310 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:53.304267    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:57.804666 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:07:57.804622    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:07:58.217202 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:07:58.217118    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:08:02.914409 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:02.914372    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:05.849779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:05.849732    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:07.025498 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.025460    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:07.537517 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.537477    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"]
Oct 30 20:08:07.538185 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.538167    6015 cpu_manager.go:414] "containerMap: removing container" podUID="fb24b90e-8a67-4504-95dd-1af78f642318" containerName="payload-processing"
Oct 30 20:08:07.538185 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.538185    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb24b90e-8a67-4504-95dd-1af78f642318" containerName="payload-processing"
Oct 30 20:08:07.538349 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.538292    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb24b90e-8a67-4504-95dd-1af78f642318" containerName="payload-processing"
Oct 30 20:08:07.540834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.540791    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.591295 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.591260    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-praxis-b-115a78-openshift-default-dockercfg-js28r\""
Oct 30 20:08:07.641629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.641593    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"]
Oct 30 20:08:07.645537 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.645505    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:07.702878 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.702801    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-data\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.703260 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.703236    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-token\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.703428 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.703403    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istiod-ca-cert\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.703612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.703493    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-envoy\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.703612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.703535    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-socket\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.703741 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.703646    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-credential-socket\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.703846 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.703784    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4s8c\" (UniqueName: \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-kube-api-access-l4s8c\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.703929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.703842    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-certs\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.703929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.703907    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-podinfo\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.805488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.805452    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-certs\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.805659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.805499    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-podinfo\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.805659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.805561    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-data\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.805659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.805602    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-token\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.805659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.805629    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istiod-ca-cert\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.805912 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.805702    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-envoy\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.805912 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.805744    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-socket\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.806022 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.805921    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-certs\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.806022 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.805923    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-credential-socket\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.806135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.806027    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-data\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.806135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.806068    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4s8c\" (UniqueName: \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-kube-api-access-l4s8c\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.806256 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.806213    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-socket\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.806256 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.806228    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-credential-socket\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.806593 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.806565    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istiod-ca-cert\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.808270 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.808245    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-envoy\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.808648 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.808614    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-podinfo\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.864524 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.864477    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4s8c\" (UniqueName: \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-kube-api-access-l4s8c\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.865422 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.865392    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-token\") pod \"e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") " pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:07.897273 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:07.897230    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:08.153244 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:08.153140    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:08.534622 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:08.534513    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:08.595137 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:08.595096    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"]
Oct 30 20:08:08.600931 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:08:08.600904    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3c71a4_65a1_4529_b173_359e6c2fb3fd.slice/crio-9e2d3a5f0fec657fc8efdea756c5c378e661a5fbca20285dbe65f4a331f1e9cc WatchSource:0}: Error finding container 9e2d3a5f0fec657fc8efdea756c5c378e661a5fbca20285dbe65f4a331f1e9cc: Status 404 returned error can't find the container with id 9e2d3a5f0fec657fc8efdea756c5c378e661a5fbca20285dbe65f4a331f1e9cc
Oct 30 20:08:08.603625 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:08.603592    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:08.603696 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:08.603662    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:08.603696 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:08.603687    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:08.984649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:08.984607    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" event={"ID":"ad3c71a4-65a1-4529-b173-359e6c2fb3fd","Type":"ContainerStarted","Data":"cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5"}
Oct 30 20:08:08.985235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:08.984672    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" event={"ID":"ad3c71a4-65a1-4529-b173-359e6c2fb3fd","Type":"ContainerStarted","Data":"9e2d3a5f0fec657fc8efdea756c5c378e661a5fbca20285dbe65f4a331f1e9cc"}
Oct 30 20:08:09.120409 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:09.120338    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" podStartSLOduration=2.120316894 podStartE2EDuration="2.120316894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:08:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:08:09.113956695 +0000 UTC m=+2551.656763960" watchObservedRunningTime="2026-10-30 20:08:09.120316894 +0000 UTC m=+2551.663124161"
Oct 30 20:08:09.154170 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:09.154133    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:09.160227 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:09.160196    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:09.991960 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:09.991928    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:09.993039 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:09.993009    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:08:12.707403 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:12.707364    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:12.949511 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:12.949471    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:13.128142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:13.128101    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:15.848530 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:15.848490    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:16.015081 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:16.015020    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:16.207089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:16.206992    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:20.446049 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:20.446002    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:22.131797 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:22.131753    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:22.362410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:22.362365    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:22.564959 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:22.564923    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:23.132187 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:23.132144    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:27.824674 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:27.824627    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:28.217048 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:08:28.216959    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:08:30.040047 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:30.040004    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:30.262860 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:30.262784    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:30.419611 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:30.419574    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"]
Oct 30 20:08:30.419874 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:30.419851    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy" containerID="cri-o://ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a" gracePeriod=30
Oct 30 20:08:30.461963 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:30.461921    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:32.078320 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.078285    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:32.470744 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.470644    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"]
Oct 30 20:08:32.474157 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.474136    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.532430 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.532402    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-praxis-a-389c4e-openshift-default-dockercfg-kmrqw\""
Oct 30 20:08:32.535165 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.535128    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d44s5\" (UniqueName: \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-kube-api-access-d44s5\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.535334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.535176    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/316545b0-a292-4371-8fa0-3ef162b2d4b9-istiod-ca-cert\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.535334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.535271    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-socket\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.535473 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.535384    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-podinfo\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.535473 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.535462    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-token\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.535599 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.535582    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-envoy\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.535659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.535630    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-certs\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.535738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.535715    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-credential-socket\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.535786 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.535747    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-data\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.575356 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.575325    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"]
Oct 30 20:08:32.638636 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.638594    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-podinfo\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.639907 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.638953    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-token\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.643841 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.643765    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-envoy\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.643989 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.643854    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-certs\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.643989 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.643885    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-credential-socket\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.643989 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.643914    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-data\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.644169 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.644068    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d44s5\" (UniqueName: \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-kube-api-access-d44s5\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.644169 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.644120    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/316545b0-a292-4371-8fa0-3ef162b2d4b9-istiod-ca-cert\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.644267 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.644166    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-socket\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.644697 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.644671    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-socket\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.647279 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.647205    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/316545b0-a292-4371-8fa0-3ef162b2d4b9-istiod-ca-cert\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.648512 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.648466    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-credential-socket\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.648981 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.648957    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-certs\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.649121 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.649097    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-data\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.651056 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.651016    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"]
Oct 30 20:08:32.653066 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.653042    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-podinfo\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.667146 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.667110    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-envoy\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.668377 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.668352    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.708662 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.708617    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d44s5\" (UniqueName: \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-kube-api-access-d44s5\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.713384 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.713348    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-token\") pod \"e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") " pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.725051 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.724969    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-praxis-a-e6b14d-openshift-default-dockercfg-6kk49\""
Oct 30 20:08:32.727917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.727884    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"]
Oct 30 20:08:32.745543 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.745510    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-socket\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.745739 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.745563    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-token\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.745789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.745744    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-podinfo\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.745878 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.745861    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-certs\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.745928 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.745905    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d6b6381-6e22-4028-b331-cdd94f5de7de-istiod-ca-cert\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.746008 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.745993    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-credential-socket\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.746046 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.746035    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxrtj\" (UniqueName: \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-kube-api-access-cxrtj\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.746186 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.746143    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-envoy\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.746273 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.746254    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-data\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.789361 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.789318    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:32.847625 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.847558    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-credential-socket\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.847625 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.847620    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxrtj\" (UniqueName: \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-kube-api-access-cxrtj\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.847922 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.847654    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-envoy\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.847922 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.847728    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-data\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.847922 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.847874    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-socket\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.847922 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.847912    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-token\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.848159 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.848000    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-podinfo\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.848159 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.848057    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-certs\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.848159 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.848099    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d6b6381-6e22-4028-b331-cdd94f5de7de-istiod-ca-cert\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.848997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.848965    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-credential-socket\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.849193 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.849166    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d6b6381-6e22-4028-b331-cdd94f5de7de-istiod-ca-cert\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.849330 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.849310    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-data\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.849738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.849693    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-socket\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.849909 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.849733    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-certs\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.853574 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.853536    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-podinfo\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.854416 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.854395    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-envoy\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.909781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.909743    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-token\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.913639 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.913611    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxrtj\" (UniqueName: \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-kube-api-access-cxrtj\") pod \"e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") " pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:32.924877 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.924844    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:32.994951 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:32.994850    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:33.232868 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:33.232834    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"]
Oct 30 20:08:33.238330 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:08:33.238302    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod316545b0_a292_4371_8fa0_3ef162b2d4b9.slice/crio-26b4d0c0d3a0358820f557dbbee730cf19cbdd7527c1a841e0ea3e70a4770e7a WatchSource:0}: Error finding container 26b4d0c0d3a0358820f557dbbee730cf19cbdd7527c1a841e0ea3e70a4770e7a: Status 404 returned error can't find the container with id 26b4d0c0d3a0358820f557dbbee730cf19cbdd7527c1a841e0ea3e70a4770e7a
Oct 30 20:08:33.241080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:33.241048    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:33.241170 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:33.241128    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:33.241170 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:33.241157    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:33.273417 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:33.273381    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:33.393449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:33.393414    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"]
Oct 30 20:08:33.398127 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:08:33.398097    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d6b6381_6e22_4028_b331_cdd94f5de7de.slice/crio-278b87aec37f38915a077859b5c22bc0b0a00761e35fef4d29698cc6037c418d WatchSource:0}: Error finding container 278b87aec37f38915a077859b5c22bc0b0a00761e35fef4d29698cc6037c418d: Status 404 returned error can't find the container with id 278b87aec37f38915a077859b5c22bc0b0a00761e35fef4d29698cc6037c418d
Oct 30 20:08:33.400957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:33.400920    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:33.401081 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:33.401011    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:33.401081 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:33.401057    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:34.187832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:34.183189    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh" event={"ID":"316545b0-a292-4371-8fa0-3ef162b2d4b9","Type":"ContainerStarted","Data":"127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6"}
Oct 30 20:08:34.187832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:34.183285    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh" event={"ID":"316545b0-a292-4371-8fa0-3ef162b2d4b9","Type":"ContainerStarted","Data":"26b4d0c0d3a0358820f557dbbee730cf19cbdd7527c1a841e0ea3e70a4770e7a"}
Oct 30 20:08:34.187832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:34.187728    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" event={"ID":"9d6b6381-6e22-4028-b331-cdd94f5de7de","Type":"ContainerStarted","Data":"aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d"}
Oct 30 20:08:34.187832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:34.187793    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" event={"ID":"9d6b6381-6e22-4028-b331-cdd94f5de7de","Type":"ContainerStarted","Data":"278b87aec37f38915a077859b5c22bc0b0a00761e35fef4d29698cc6037c418d"}
Oct 30 20:08:34.377570 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:34.365532    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh" podStartSLOduration=2.365508834 podStartE2EDuration="2.365508834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:08:34.363372326 +0000 UTC m=+2576.906179623" watchObservedRunningTime="2026-10-30 20:08:34.365508834 +0000 UTC m=+2576.908316100"
Oct 30 20:08:34.796272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:34.796068    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:34.797973 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:34.797943    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:08:34.798100 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:34.798002    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh" podUID="316545b0-a292-4371-8fa0-3ef162b2d4b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:08:34.995975 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:34.995930    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:35.001649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.001617    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:35.118212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.118107    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" podStartSLOduration=3.118087915 podStartE2EDuration="3.118087915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:08:34.496226668 +0000 UTC m=+2577.039033960" watchObservedRunningTime="2026-10-30 20:08:35.118087915 +0000 UTC m=+2577.660895247"
Oct 30 20:08:35.195864 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.195821    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:35.196845 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.196785    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:08:35.747153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.747111    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:08:35.790293 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.790254    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:08:35.790583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.790548    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh" podUID="316545b0-a292-4371-8fa0-3ef162b2d4b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:08:35.916566 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.916527    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/931bf764-99e5-43a7-af49-a994ac30a68a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/931bf764-99e5-43a7-af49-a994ac30a68a-istiod-ca-cert\") pod \"931bf764-99e5-43a7-af49-a994ac30a68a\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") "
Oct 30 20:08:35.916566 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.916570    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-envoy\") pod \"931bf764-99e5-43a7-af49-a994ac30a68a\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") "
Oct 30 20:08:35.916879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.916755    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-istio-token\" (UniqueName: \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-istio-token\") pod \"931bf764-99e5-43a7-af49-a994ac30a68a\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") "
Oct 30 20:08:35.916879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.916824    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-certs\") pod \"931bf764-99e5-43a7-af49-a994ac30a68a\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") "
Oct 30 20:08:35.916998 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.916902    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-socket\") pod \"931bf764-99e5-43a7-af49-a994ac30a68a\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") "
Oct 30 20:08:35.917054 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.917037    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-data\") pod \"931bf764-99e5-43a7-af49-a994ac30a68a\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") "
Oct 30 20:08:35.917142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.917122    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-kube-api-access-2rg8f\" (UniqueName: \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-kube-api-access-2rg8f\") pod \"931bf764-99e5-43a7-af49-a994ac30a68a\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") "
Oct 30 20:08:35.917228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.917211    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-credential-socket\") pod \"931bf764-99e5-43a7-af49-a994ac30a68a\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") "
Oct 30 20:08:35.917274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.917243    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-certs" pod "931bf764-99e5-43a7-af49-a994ac30a68a" (UID: "931bf764-99e5-43a7-af49-a994ac30a68a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:35.917322 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.917307    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/931bf764-99e5-43a7-af49-a994ac30a68a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/931bf764-99e5-43a7-af49-a994ac30a68a-istio-podinfo\") pod \"931bf764-99e5-43a7-af49-a994ac30a68a\" (UID: \"931bf764-99e5-43a7-af49-a994ac30a68a\") "
Oct 30 20:08:35.918153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.917657    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/931bf764-99e5-43a7-af49-a994ac30a68a-istiod-ca-cert" pod "931bf764-99e5-43a7-af49-a994ac30a68a" (UID: "931bf764-99e5-43a7-af49-a994ac30a68a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:08:35.918153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.918120    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-data" pod "931bf764-99e5-43a7-af49-a994ac30a68a" (UID: "931bf764-99e5-43a7-af49-a994ac30a68a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:35.918354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.918167    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-credential-socket" pod "931bf764-99e5-43a7-af49-a994ac30a68a" (UID: "931bf764-99e5-43a7-af49-a994ac30a68a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:35.918354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.918171    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/931bf764-99e5-43a7-af49-a994ac30a68a-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:08:35.918354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.918208    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:08:35.918705 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.918681    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-socket" pod "931bf764-99e5-43a7-af49-a994ac30a68a" (UID: "931bf764-99e5-43a7-af49-a994ac30a68a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:35.919433 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.919405    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-envoy" pod "931bf764-99e5-43a7-af49-a994ac30a68a" (UID: "931bf764-99e5-43a7-af49-a994ac30a68a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:08:35.921350 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.921325    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-istio-token" pod "931bf764-99e5-43a7-af49-a994ac30a68a" (UID: "931bf764-99e5-43a7-af49-a994ac30a68a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:35.924106 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.922234    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/931bf764-99e5-43a7-af49-a994ac30a68a-istio-podinfo" pod "931bf764-99e5-43a7-af49-a994ac30a68a" (UID: "931bf764-99e5-43a7-af49-a994ac30a68a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:08:35.924781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:35.924349    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-kube-api-access-2rg8f" pod "931bf764-99e5-43a7-af49-a994ac30a68a" (UID: "931bf764-99e5-43a7-af49-a994ac30a68a"). InnerVolumeSpecName "kube-api-access-2rg8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:08:36.019245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.019147    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:08:36.019245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.019182    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:08:36.019245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.019196    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rg8f\" (UniqueName: \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-kube-api-access-2rg8f\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:08:36.019245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.019209    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:08:36.019245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.019221    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/931bf764-99e5-43a7-af49-a994ac30a68a-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:08:36.019245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.019233    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/931bf764-99e5-43a7-af49-a994ac30a68a-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:08:36.019245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.019244    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/931bf764-99e5-43a7-af49-a994ac30a68a-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:08:36.204232 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.204198    6015 generic.go:356] "Generic (PLEG): container finished" podID="931bf764-99e5-43a7-af49-a994ac30a68a" containerID="ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a" exitCode=0
Oct 30 20:08:36.204445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.204252    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"
Oct 30 20:08:36.204445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.204283    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" event={"ID":"931bf764-99e5-43a7-af49-a994ac30a68a","Type":"ContainerDied","Data":"ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a"}
Oct 30 20:08:36.204445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.204346    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" event={"ID":"931bf764-99e5-43a7-af49-a994ac30a68a","Type":"ContainerDied","Data":"24b4f58999d6483edfb37b2adabf4c1bfd6ee419da1bbd49b3970fc21d541354"}
Oct 30 20:08:36.204445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.204377    6015 scope.go:122] "RemoveContainer" containerID="ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a"
Oct 30 20:08:36.215348 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.215325    6015 scope.go:122] "RemoveContainer" containerID="0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41"
Oct 30 20:08:36.225431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.225413    6015 scope.go:122] "RemoveContainer" containerID="ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a"
Oct 30 20:08:36.225730 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:08:36.225707    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a\": container with ID starting with ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a not found: ID does not exist" containerID="ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a"
Oct 30 20:08:36.225884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.225739    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a"} err="failed to get container status \"ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a\": rpc error: code = NotFound desc = could not find container \"ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a\": container with ID starting with ef39b03284d224c3a75c441cb6f12ed158c17f1be6ef95122f13d635b7f0d88a not found: ID does not exist"
Oct 30 20:08:36.225884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.225766    6015 scope.go:122] "RemoveContainer" containerID="0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41"
Oct 30 20:08:36.226070 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:08:36.226052    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41\": container with ID starting with 0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41 not found: ID does not exist" containerID="0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41"
Oct 30 20:08:36.226129 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.226078    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41"} err="failed to get container status \"0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41\": rpc error: code = NotFound desc = could not find container \"0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41\": container with ID starting with 0bbfa45d0e1852ac468cff9434065dd3843234d07ff6f9b919a931c8a56fca41 not found: ID does not exist"
Oct 30 20:08:36.362006 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.361969    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"]
Oct 30 20:08:36.408856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.408793    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56"]
Oct 30 20:08:36.656902 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.656779    6015 patch_prober.go:29] interesting pod/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:08:36.656902 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.656874    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-f700fe-openshift-default-6bbbbddb77-pck56" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:08:36.790833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.790352    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:08:36.790833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:36.790434    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh" podUID="316545b0-a292-4371-8fa0-3ef162b2d4b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:08:37.431166 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:37.431131    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:37.617258 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:37.617217    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" path="/var/lib/kubelet/pods/931bf764-99e5-43a7-af49-a994ac30a68a/volumes"
Oct 30 20:08:37.655034 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:37.655001    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:37.790358 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:37.790259    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:08:37.790358 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:37.790320    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh" podUID="316545b0-a292-4371-8fa0-3ef162b2d4b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:08:38.658921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:38.658884    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:38.790491 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:38.790397    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 20:08:38.790491 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:38.790450    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh" podUID="316545b0-a292-4371-8fa0-3ef162b2d4b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 20:08:39.794781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:39.794742    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:39.795243 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:39.795065    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:39.795827 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:39.795789    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:08:40.879479 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:40.879435    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:41.082313 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:41.082279    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:44.297711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:44.297679    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:47.885290 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:47.885254    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:49.086409 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.086364    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:49.609832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.609764    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"]
Oct 30 20:08:49.610728 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.610707    6015 cpu_manager.go:414] "containerMap: removing container" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy"
Oct 30 20:08:49.610786 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.610732    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy"
Oct 30 20:08:49.610786 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.610758    6015 cpu_manager.go:414] "containerMap: removing container" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy"
Oct 30 20:08:49.610786 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.610767    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy"
Oct 30 20:08:49.611007 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.610992    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy"
Oct 30 20:08:49.611071 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.611014    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="931bf764-99e5-43a7-af49-a994ac30a68a" containerName="istio-proxy"
Oct 30 20:08:49.614659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.614638    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.668291 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.668240    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-praxis-b-a3c171-openshift-default-dockercfg-lrj8n\""
Oct 30 20:08:49.719615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.719564    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lktlv\" (UniqueName: \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-kube-api-access-lktlv\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.721266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.721238    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-socket\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.721518 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.721495    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-podinfo\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.721914 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.721885    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istiod-ca-cert\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.722032 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.721937    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-token\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.722032 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.721978    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-certs\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.722032 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.722002    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-data\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.722211 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.722075    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-credential-socket\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.722211 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.722108    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-envoy\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.735762 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.734667    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:49.820439 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.820397    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"]
Oct 30 20:08:49.823594 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.823558    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-socket\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.823784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.823607    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-podinfo\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.823784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.823712    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istiod-ca-cert\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.823784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.823763    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-token\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.824033 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.823820    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-certs\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.824033 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.823845    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-data\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.824033 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.823914    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-credential-socket\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.824033 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.823944    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-envoy\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.824245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.824054    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lktlv\" (UniqueName: \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-kube-api-access-lktlv\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.824245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.824119    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-socket\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.824514 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.824488    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-data\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.824747 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.824722    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-certs\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.825020 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.824994    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-credential-socket\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.825151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.825130    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istiod-ca-cert\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.833520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.833485    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-podinfo\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.837584 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.837537    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-envoy\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.882885 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.882766    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-token\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.883075 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.883054    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lktlv\" (UniqueName: \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-kube-api-access-lktlv\") pod \"e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") " pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:49.894643 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.894611    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:49.929234 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:49.929195    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:50.059920 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:50.059784    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:50.380573 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:50.380520    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"]
Oct 30 20:08:50.421472 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:08:50.421438    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f68b4b_340c_40a9_a440_2ba4a6c417dd.slice/crio-d1b20c0cd258e0f5e84c584eecd121bd3249db0c12cec454b88fbd019d031ab0 WatchSource:0}: Error finding container d1b20c0cd258e0f5e84c584eecd121bd3249db0c12cec454b88fbd019d031ab0: Status 404 returned error can't find the container with id d1b20c0cd258e0f5e84c584eecd121bd3249db0c12cec454b88fbd019d031ab0
Oct 30 20:08:50.424166 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:50.424138    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:50.424267 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:50.424212    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:50.424267 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:50.424240    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:08:51.310089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:51.310046    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" event={"ID":"a3f68b4b-340c-40a9-a440-2ba4a6c417dd","Type":"ContainerStarted","Data":"ada75a4a0321c2c4c901df2c5a00b435b3e5872e0fbf91536dac7b6f54d4b8b2"}
Oct 30 20:08:51.310303 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:51.310146    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" event={"ID":"a3f68b4b-340c-40a9-a440-2ba4a6c417dd","Type":"ContainerStarted","Data":"d1b20c0cd258e0f5e84c584eecd121bd3249db0c12cec454b88fbd019d031ab0"}
Oct 30 20:08:51.476170 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:51.476119    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" podStartSLOduration=2.476104466 podStartE2EDuration="2.476104466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:08:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:08:51.473655075 +0000 UTC m=+2594.016462365" watchObservedRunningTime="2026-10-30 20:08:51.476104466 +0000 UTC m=+2594.018911793"
Oct 30 20:08:51.930021 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:51.929981    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:51.936461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:51.936431    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:52.316839 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:52.316774    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:52.317791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:52.317774    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:08:53.595063 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:53.595026    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:53.812289 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:53.812257    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:54.309477 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:54.309443    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:54.480657 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:54.480620    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:54.669454 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:54.669355    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:54.973041 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:54.972948    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:56.330512 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:56.330468    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:56.502777 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:56.502734    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:57.607507 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:57.607469    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:57.773474 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:57.773440    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:57.937872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:08:57.937303    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:08:58.251333 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:08:58.251247    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:09:00.440438 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:00.440402    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:00.699539 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:00.699440    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:03.049473 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:03.049437    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:03.828196 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:03.828156    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:04.032480 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:04.032441    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:08.300952 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:08.300897    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:13.581783 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:13.581734    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:20.340756 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:20.340668    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:20.582524 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:20.582487    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:25.580715 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:25.580678    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:28.216319 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:09:28.216282    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:09:30.577799 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:30.577759    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:35.600292 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:35.600252    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:36.551820 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:36.551773    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:36.720622 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:36.720583    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:40.630282 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:40.630248    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:45.531904 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:45.531855    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:45.736712 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:45.736671    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:45.907273 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:45.907230    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:50.776454 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:50.776412    6015 generic.go:356] "Generic (PLEG): container finished" podID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerID="cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5" exitCode=0
Oct 30 20:09:50.777030 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:50.776483    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" event={"ID":"ad3c71a4-65a1-4529-b173-359e6c2fb3fd","Type":"ContainerDied","Data":"cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5"}
Oct 30 20:09:50.777030 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:50.777025    6015 scope.go:122] "RemoveContainer" containerID="cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5"
Oct 30 20:09:50.779120 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:50.779086    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:09:50.779215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:50.779181    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:09:50.779254 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:50.779242    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:09:50.814996 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:50.814969    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:51.798020 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:51.797980    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" event={"ID":"ad3c71a4-65a1-4529-b173-359e6c2fb3fd","Type":"ContainerStarted","Data":"42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198"}
Oct 30 20:09:52.154362 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:52.154273    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:09:52.155503 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:52.155472    6015 patch_prober.go:29] interesting pod/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 20:09:52.155622 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:52.155528    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 20:09:53.154312 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:53.154275    6015 patch_prober.go:29] interesting pod/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 20:09:53.154732 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:53.154349    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 20:09:53.942545 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:53.942508    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:54.153861 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:54.153821    6015 patch_prober.go:29] interesting pod/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 20:09:54.154032 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:54.153886    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 20:09:54.993009 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:54.992966    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:09:55.153725 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:55.153684    6015 patch_prober.go:29] interesting pod/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 20:09:55.153950 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:55.153743    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 20:09:55.940004 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:55.939949    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:09:56.153560 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:56.153519    6015 patch_prober.go:29] interesting pod/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 20:09:56.154005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:56.153577    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 20:09:57.157983 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:57.157951    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:09:57.159096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:09:57.159073    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:09:58.217708 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:09:58.217666    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:10:01.033258 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:01.033202    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:07.740884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:07.740724    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:09.307649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:09.307610    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:13.062297 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:13.062246    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:18.082556 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:18.082502    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:18.240578 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:18.240538    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:18.396926 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:18.396835    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:19.080817 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:19.080762    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn_0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731/payload-processing/0.log"
Oct 30 20:10:20.007473 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:20.007434    6015 generic.go:356] "Generic (PLEG): container finished" podID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerID="aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d" exitCode=0
Oct 30 20:10:20.008012 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:20.007506    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" event={"ID":"9d6b6381-6e22-4028-b331-cdd94f5de7de","Type":"ContainerDied","Data":"aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d"}
Oct 30 20:10:20.008012 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:20.007990    6015 scope.go:122] "RemoveContainer" containerID="aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d"
Oct 30 20:10:20.009544 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:20.009518    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:10:20.009611 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:20.009594    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:10:20.009646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:20.009632    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:10:20.028781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:20.028755    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp_50b86726-1ec5-4ad0-9b6e-9e12b6718eec/payload-processing/0.log"
Oct 30 20:10:20.195747 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:20.195714    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:10:20.279721 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:20.279642    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp_50b86726-1ec5-4ad0-9b6e-9e12b6718eec/payload-processing/0.log"
Oct 30 20:10:21.016082 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:21.016048    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" event={"ID":"9d6b6381-6e22-4028-b331-cdd94f5de7de","Type":"ContainerStarted","Data":"23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8"}
Oct 30 20:10:21.995857 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:21.995782    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:10:21.997499 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:21.997467    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.123:15021/healthz/ready\": dial tcp 10.134.0.123:15021: connect: connection refused" start-of-body=
Oct 30 20:10:21.997638 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:21.997522    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.123:15021/healthz/ready\": dial tcp 10.134.0.123:15021: connect: connection refused"
Oct 30 20:10:22.996007 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:22.995968    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.123:15021/healthz/ready\": dial tcp 10.134.0.123:15021: connect: connection refused" start-of-body=
Oct 30 20:10:22.996433 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:22.996028    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.123:15021/healthz/ready\": dial tcp 10.134.0.123:15021: connect: connection refused"
Oct 30 20:10:23.558270 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:23.558216    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:23.995414 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:23.995292    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.123:15021/healthz/ready\": dial tcp 10.134.0.123:15021: connect: connection refused" start-of-body=
Oct 30 20:10:23.995414 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:23.995368    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.123:15021/healthz/ready\": dial tcp 10.134.0.123:15021: connect: connection refused"
Oct 30 20:10:24.996305 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:24.996270    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.123:15021/healthz/ready\": dial tcp 10.134.0.123:15021: connect: connection refused" start-of-body=
Oct 30 20:10:24.996843 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:24.996788    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.123:15021/healthz/ready\": dial tcp 10.134.0.123:15021: connect: connection refused"
Oct 30 20:10:25.996212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:25.996167    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.123:15021/healthz/ready\": dial tcp 10.134.0.123:15021: connect: connection refused" start-of-body=
Oct 30 20:10:25.996523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:25.996492    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.123:15021/healthz/ready\": dial tcp 10.134.0.123:15021: connect: connection refused"
Oct 30 20:10:27.002169 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:27.002130    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:10:27.003417 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:27.003391    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:10:27.004230 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:27.004210    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:10:28.216223 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:10:28.216183    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:10:28.713021 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:28.712983    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:34.025485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:34.025449    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:40.855655 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:40.855610    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:41.217302 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:41.217208    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:43.166657 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:43.166620    6015 generic.go:356] "Generic (PLEG): container finished" podID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerID="ada75a4a0321c2c4c901df2c5a00b435b3e5872e0fbf91536dac7b6f54d4b8b2" exitCode=0
Oct 30 20:10:43.167228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:43.166660    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" event={"ID":"a3f68b4b-340c-40a9-a440-2ba4a6c417dd","Type":"ContainerDied","Data":"ada75a4a0321c2c4c901df2c5a00b435b3e5872e0fbf91536dac7b6f54d4b8b2"}
Oct 30 20:10:43.167228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:43.167155    6015 scope.go:122] "RemoveContainer" containerID="ada75a4a0321c2c4c901df2c5a00b435b3e5872e0fbf91536dac7b6f54d4b8b2"
Oct 30 20:10:43.168976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:43.168949    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:10:43.169250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:43.169031    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:10:43.169250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:43.169083    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:10:44.203873 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:44.203825    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" event={"ID":"a3f68b4b-340c-40a9-a440-2ba4a6c417dd","Type":"ContainerStarted","Data":"4ec7515e6a82a2b2d31744aab3325a280928e4e53d38be0d94cb7077ac6e6a55"}
Oct 30 20:10:44.929841 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:44.929766    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:10:44.930110 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:44.930085    6015 patch_prober.go:29] interesting pod/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.124:15021/healthz/ready\": dial tcp 10.134.0.124:15021: connect: connection refused" start-of-body=
Oct 30 20:10:44.930165 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:44.930142    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.124:15021/healthz/ready\": dial tcp 10.134.0.124:15021: connect: connection refused"
Oct 30 20:10:45.803004 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:45.802968    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:45.929884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:45.929767    6015 patch_prober.go:29] interesting pod/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.124:15021/healthz/ready\": dial tcp 10.134.0.124:15021: connect: connection refused" start-of-body=
Oct 30 20:10:45.929884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:45.929851    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.124:15021/healthz/ready\": dial tcp 10.134.0.124:15021: connect: connection refused"
Oct 30 20:10:45.960409 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:45.960369    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:46.929738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:46.929700    6015 patch_prober.go:29] interesting pod/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.124:15021/healthz/ready\": dial tcp 10.134.0.124:15021: connect: connection refused" start-of-body=
Oct 30 20:10:46.930191 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:46.929758    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.124:15021/healthz/ready\": dial tcp 10.134.0.124:15021: connect: connection refused"
Oct 30 20:10:47.930299 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:47.930255    6015 patch_prober.go:29] interesting pod/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.124:15021/healthz/ready\": dial tcp 10.134.0.124:15021: connect: connection refused" start-of-body=
Oct 30 20:10:47.930702 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:47.930329    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.124:15021/healthz/ready\": dial tcp 10.134.0.124:15021: connect: connection refused"
Oct 30 20:10:48.929613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:48.929573    6015 patch_prober.go:29] interesting pod/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.124:15021/healthz/ready\": dial tcp 10.134.0.124:15021: connect: connection refused" start-of-body=
Oct 30 20:10:48.929819 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:48.929632    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.124:15021/healthz/ready\": dial tcp 10.134.0.124:15021: connect: connection refused"
Oct 30 20:10:49.935695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:49.935661    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:10:49.936199 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:49.935945    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:10:49.936884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:49.936865    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:10:50.762354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:50.762311    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:51.608600 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:51.608554    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:54.285192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:54.285155    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:57.012256 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:10:57.012219    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:10:58.216367 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:10:58.216325    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:11:02.452074 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:02.451951    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:04.862564 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:04.862533    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:05.026052 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:05.025991    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:07.627226 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:07.627186    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:12.812218 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:12.812168    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:16.190543 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:16.190499    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:17.453301 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:17.453255    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:18.419485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:18.419446    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:18.752998 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:18.752899    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:22.506793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:22.506757    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:22.717468 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:22.717422    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:23.970314 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:23.970277    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:25.886523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:25.886487    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:26.222140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:26.222049    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:28.216564 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:11:28.216525    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:11:29.812694 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:29.812657    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:33.031295 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:33.031252    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:35.437681 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:35.437637    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:38.451283 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:38.451248    6015 scope.go:122] "RemoveContainer" containerID="f9b405aab531a92bc64a49faa9130e611bd7812345eae47e8840a7a1eea853fe"
Oct 30 20:11:40.407079 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:40.407036    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:42.085018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:42.084975    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:42.506711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:42.506536    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:42.668553 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:42.668519    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:43.140002 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:43.139958    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:44.315273 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:44.315220    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:47.924280 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:47.924239    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:48.101654 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:48.101622    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:48.364668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:48.364630    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:48.519588 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:48.519544    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:48.676731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:48.676620    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:50.250616 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:50.250570    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:50.406424 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:50.406389    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:50.690572 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:50.690536    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"]
Oct 30 20:11:50.690929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:50.690760    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy" containerID="cri-o://118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2" gracePeriod=30
Oct 30 20:11:50.699024 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:50.698990    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:51.547083 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:51.547045    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:11:51.547596 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:51.547105    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:11:54.635940 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:54.635903    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:55.849132 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:55.849088    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:11:55.982661 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:55.982627    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:11:56.045611 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.045577    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-kube-api-access-qz9sc\" (UniqueName: \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-kube-api-access-qz9sc\") pod \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") "
Oct 30 20:11:56.045852 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.045645    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istiod-ca-cert\") pod \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") "
Oct 30 20:11:56.045852 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.045669    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-data\") pod \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") "
Oct 30 20:11:56.045852 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.045694    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-envoy\") pod \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") "
Oct 30 20:11:56.045852 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.045714    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-podinfo\") pod \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") "
Oct 30 20:11:56.045852 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.045745    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-credential-socket\") pod \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") "
Oct 30 20:11:56.046120 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.045917    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-token\" (UniqueName: \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-token\") pod \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") "
Oct 30 20:11:56.046120 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.045976    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-data" pod "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" (UID: "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:11:56.046120 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.046028    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-certs\") pod \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") "
Oct 30 20:11:56.046120 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.046106    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-socket\") pod \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\" (UID: \"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88\") "
Oct 30 20:11:56.046329 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.046152    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-credential-socket" pod "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" (UID: "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:11:56.046329 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.046238    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istiod-ca-cert" pod "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" (UID: "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:11:56.046610 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.046557    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-socket" pod "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" (UID: "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:11:56.046722 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.046705    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-certs" pod "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" (UID: "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:11:56.047061 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.047037    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:11:56.047120 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.047069    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:11:56.047120 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.047087    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:11:56.047120 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.047102    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:11:56.047235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.047118    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:11:56.048139 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.048121    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-kube-api-access-qz9sc" pod "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" (UID: "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88"). InnerVolumeSpecName "kube-api-access-qz9sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:11:56.048440 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.048411    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-podinfo" pod "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" (UID: "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:11:56.048724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.048704    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-envoy" pod "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" (UID: "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:11:56.048782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.048758    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-token" pod "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" (UID: "3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:11:56.149008 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.148974    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:11:56.149008 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.149010    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz9sc\" (UniqueName: \"kubernetes.io/projected/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-kube-api-access-qz9sc\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:11:56.149228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.149022    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:11:56.149228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.149031    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:11:56.735792 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.735758    6015 generic.go:356] "Generic (PLEG): container finished" podID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerID="118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2" exitCode=0
Oct 30 20:11:56.735792 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.735799    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" event={"ID":"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88","Type":"ContainerDied","Data":"118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2"}
Oct 30 20:11:56.736122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.735829    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"
Oct 30 20:11:56.736122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.735873    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg" event={"ID":"3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88","Type":"ContainerDied","Data":"9d9d840457311e858768dec351d0233f4116a3247738de9ef5b8a1e852faf145"}
Oct 30 20:11:56.736122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.735902    6015 scope.go:122] "RemoveContainer" containerID="118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2"
Oct 30 20:11:56.747330 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.747307    6015 scope.go:122] "RemoveContainer" containerID="b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3"
Oct 30 20:11:56.756896 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.756875    6015 scope.go:122] "RemoveContainer" containerID="118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2"
Oct 30 20:11:56.757209 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:11:56.757186    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2\": container with ID starting with 118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2 not found: ID does not exist" containerID="118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2"
Oct 30 20:11:56.757273 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.757220    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2"} err="failed to get container status \"118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2\": rpc error: code = NotFound desc = could not find container \"118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2\": container with ID starting with 118a13bc462f4e834ec74321eddeb1cb2764abc56025397d36c7dbfe26ebaae2 not found: ID does not exist"
Oct 30 20:11:56.757273 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.757237    6015 scope.go:122] "RemoveContainer" containerID="b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3"
Oct 30 20:11:56.757512 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:11:56.757497    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3\": container with ID starting with b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3 not found: ID does not exist" containerID="b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3"
Oct 30 20:11:56.757552 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.757517    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3"} err="failed to get container status \"b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3\": rpc error: code = NotFound desc = could not find container \"b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3\": container with ID starting with b343e78ff107ded214d16c56b274a3227f455dd0d0919c0a193ef2163121eed3 not found: ID does not exist"
Oct 30 20:11:56.943173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:56.943127    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"]
Oct 30 20:11:57.036147 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:57.036059    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-praxis-a-f61bae-openshift-default-64cfbd4f9c-tvhsg"]
Oct 30 20:11:57.587789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:11:57.587746    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" path="/var/lib/kubelet/pods/3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88/volumes"
Oct 30 20:11:58.220161 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:11:58.220126    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:12:00.964716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:00.964670    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:01.209183 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:01.209072    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"]
Oct 30 20:12:01.209396 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:01.209331    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy" containerID="cri-o://a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240" gracePeriod=30
Oct 30 20:12:02.914005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:02.913961    6015 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6ns9w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:12:02.914419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:02.914034    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:12:03.425478 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:03.425439    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:03.630795 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:03.630752    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:06.005074 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.005030    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:06.484644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.484612    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 20:12:06.496092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496057    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-kube-api-access-4pxs5\" (UniqueName: \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-kube-api-access-4pxs5\") pod \"7c2f2860-b52f-4a25-ae38-2900031e33ed\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") "
Oct 30 20:12:06.496277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496135    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-token\" (UniqueName: \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-token\") pod \"7c2f2860-b52f-4a25-ae38-2900031e33ed\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") "
Oct 30 20:12:06.496277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496221    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c2f2860-b52f-4a25-ae38-2900031e33ed-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c2f2860-b52f-4a25-ae38-2900031e33ed-istiod-ca-cert\") pod \"7c2f2860-b52f-4a25-ae38-2900031e33ed\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") "
Oct 30 20:12:06.496396 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496282    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-podinfo\") pod \"7c2f2860-b52f-4a25-ae38-2900031e33ed\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") "
Oct 30 20:12:06.496396 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496362    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-data\") pod \"7c2f2860-b52f-4a25-ae38-2900031e33ed\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") "
Oct 30 20:12:06.496509 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496436    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-envoy\") pod \"7c2f2860-b52f-4a25-ae38-2900031e33ed\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") "
Oct 30 20:12:06.496509 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496473    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-credential-socket\") pod \"7c2f2860-b52f-4a25-ae38-2900031e33ed\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") "
Oct 30 20:12:06.496624 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496593    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-certs\") pod \"7c2f2860-b52f-4a25-ae38-2900031e33ed\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") "
Oct 30 20:12:06.496624 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496605    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-data" pod "7c2f2860-b52f-4a25-ae38-2900031e33ed" (UID: "7c2f2860-b52f-4a25-ae38-2900031e33ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:12:06.496733 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496612    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c2f2860-b52f-4a25-ae38-2900031e33ed-istiod-ca-cert" pod "7c2f2860-b52f-4a25-ae38-2900031e33ed" (UID: "7c2f2860-b52f-4a25-ae38-2900031e33ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:12:06.496733 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496629    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-socket\") pod \"7c2f2860-b52f-4a25-ae38-2900031e33ed\" (UID: \"7c2f2860-b52f-4a25-ae38-2900031e33ed\") "
Oct 30 20:12:06.497106 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496859    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-socket" pod "7c2f2860-b52f-4a25-ae38-2900031e33ed" (UID: "7c2f2860-b52f-4a25-ae38-2900031e33ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:12:06.497106 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.496892    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-credential-socket" pod "7c2f2860-b52f-4a25-ae38-2900031e33ed" (UID: "7c2f2860-b52f-4a25-ae38-2900031e33ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:12:06.497106 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.497078    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-certs" pod "7c2f2860-b52f-4a25-ae38-2900031e33ed" (UID: "7c2f2860-b52f-4a25-ae38-2900031e33ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:12:06.497569 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.497503    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:06.497569 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.497534    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:06.497569 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.497549    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:06.497569 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.497563    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:06.497874 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.497577    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c2f2860-b52f-4a25-ae38-2900031e33ed-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:06.498780 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.498754    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-kube-api-access-4pxs5" pod "7c2f2860-b52f-4a25-ae38-2900031e33ed" (UID: "7c2f2860-b52f-4a25-ae38-2900031e33ed"). InnerVolumeSpecName "kube-api-access-4pxs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:12:06.499044 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.499020    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-token" pod "7c2f2860-b52f-4a25-ae38-2900031e33ed" (UID: "7c2f2860-b52f-4a25-ae38-2900031e33ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:12:06.499140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.499109    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-podinfo" pod "7c2f2860-b52f-4a25-ae38-2900031e33ed" (UID: "7c2f2860-b52f-4a25-ae38-2900031e33ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:12:06.499182 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.499156    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-envoy" pod "7c2f2860-b52f-4a25-ae38-2900031e33ed" (UID: "7c2f2860-b52f-4a25-ae38-2900031e33ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:12:06.598848 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.598727    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pxs5\" (UniqueName: \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-kube-api-access-4pxs5\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:06.598848 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.598758    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:06.598848 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.598768    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:06.598848 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.598778    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c2f2860-b52f-4a25-ae38-2900031e33ed-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:06.808670 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.808638    6015 generic.go:356] "Generic (PLEG): container finished" podID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerID="a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240" exitCode=0
Oct 30 20:12:06.808906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.808698    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"
Oct 30 20:12:06.808906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.808720    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" event={"ID":"7c2f2860-b52f-4a25-ae38-2900031e33ed","Type":"ContainerDied","Data":"a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240"}
Oct 30 20:12:06.808906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.808779    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w" event={"ID":"7c2f2860-b52f-4a25-ae38-2900031e33ed","Type":"ContainerDied","Data":"eb1ffd929879ff9208b6c8d7cec656dcf5bd40d0ce1749e027887d2616d29b26"}
Oct 30 20:12:06.808906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.808801    6015 scope.go:122] "RemoveContainer" containerID="a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240"
Oct 30 20:12:06.820274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.820255    6015 scope.go:122] "RemoveContainer" containerID="a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240"
Oct 30 20:12:06.820600 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:12:06.820572    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240\": container with ID starting with a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240 not found: ID does not exist" containerID="a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240"
Oct 30 20:12:06.820655 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.820611    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240"} err="failed to get container status \"a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240\": rpc error: code = NotFound desc = could not find container \"a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240\": container with ID starting with a31ec2fdaa6125c2473821aaca39e16e9e776557abb1c98bb7b4303e9d294240 not found: ID does not exist"
Oct 30 20:12:06.965874 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:06.965744    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"]
Oct 30 20:12:07.016081 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:07.016038    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6ns9w"]
Oct 30 20:12:07.588591 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:07.588556    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" path="/var/lib/kubelet/pods/7c2f2860-b52f-4a25-ae38-2900031e33ed/volumes"
Oct 30 20:12:08.842024 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:08.841979    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:11.028104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:11.028066    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:16.019172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:16.019087    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:21.014399 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:21.014361    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:25.400487 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:25.400446    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:26.993074 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:26.993028    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:27.216878 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:27.216839    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:27.406643 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:27.406606    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:28.002993 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:28.002951    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:28.216734 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:12:28.216696    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:12:32.468892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:32.468845    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:32.676010 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:32.675973    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:34.245068 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:34.245028    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:34.397354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:34.397320    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:34.626628 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:34.626593    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:35.560127 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.560086    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"]
Oct 30 20:12:35.561092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.561072    6015 cpu_manager.go:414] "containerMap: removing container" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy"
Oct 30 20:12:35.561092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.561093    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy"
Oct 30 20:12:35.561259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.561109    6015 cpu_manager.go:414] "containerMap: removing container" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy"
Oct 30 20:12:35.561259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.561115    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy"
Oct 30 20:12:35.561259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.561126    6015 cpu_manager.go:414] "containerMap: removing container" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy"
Oct 30 20:12:35.561259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.561132    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy"
Oct 30 20:12:35.561259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.561255    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c2f2860-b52f-4a25-ae38-2900031e33ed" containerName="istio-proxy"
Oct 30 20:12:35.561259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.561263    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy"
Oct 30 20:12:35.561604 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.561271    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e3a7e3c-7e4d-4bfb-9c2c-3c76518ebd88" containerName="istio-proxy"
Oct 30 20:12:35.563789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.563772    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:35.661398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.661366    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:12:35.661623 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.661484    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kmwqm\""
Oct 30 20:12:35.664232 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.664200    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"]
Oct 30 20:12:35.677083 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.677048    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zrhf\" (UniqueName: \"kubernetes.io/projected/58579da1-0c5e-49fa-a789-bddd688c9199-kube-api-access-9zrhf\") pod \"maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:35.677286 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.677220    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:35.677380 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.677344    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:35.778948 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.778912    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zrhf\" (UniqueName: \"kubernetes.io/projected/58579da1-0c5e-49fa-a789-bddd688c9199-kube-api-access-9zrhf\") pod \"maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:35.779157 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.779022    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:35.779157 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.779082    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:35.779761 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.779734    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:35.781994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.781968    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:35.837745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.837658    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zrhf\" (UniqueName: \"kubernetes.io/projected/58579da1-0c5e-49fa-a789-bddd688c9199-kube-api-access-9zrhf\") pod \"maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:35.877704 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:35.877664    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:36.259873 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:36.259763    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"]
Oct 30 20:12:36.265639 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:12:36.265611    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58579da1_0c5e_49fa_a789_bddd688c9199.slice/crio-7a6b19a6601b3fe16eea4cfa8f67fb1c20c837a21ab3d693f580e28d1db2e950 WatchSource:0}: Error finding container 7a6b19a6601b3fe16eea4cfa8f67fb1c20c837a21ab3d693f580e28d1db2e950: Status 404 returned error can't find the container with id 7a6b19a6601b3fe16eea4cfa8f67fb1c20c837a21ab3d693f580e28d1db2e950
Oct 30 20:12:37.004173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:37.004056    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj" event={"ID":"58579da1-0c5e-49fa-a789-bddd688c9199","Type":"ContainerStarted","Data":"c036ed7304db7a3f60097ebefc6ddc6519b2d1776ee149555ad51c1685cba10b"}
Oct 30 20:12:37.004540 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:37.004176    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj" event={"ID":"58579da1-0c5e-49fa-a789-bddd688c9199","Type":"ContainerStarted","Data":"7a6b19a6601b3fe16eea4cfa8f67fb1c20c837a21ab3d693f580e28d1db2e950"}
Oct 30 20:12:37.161817 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:37.161757    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj" podStartSLOduration=2.161742111 podStartE2EDuration="2.161742111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:12:37.113203776 +0000 UTC m=+2819.656011042" watchObservedRunningTime="2026-10-30 20:12:37.161742111 +0000 UTC m=+2819.704549376"
Oct 30 20:12:37.523908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:37.523870    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:37.921610 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:37.921550    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"]
Oct 30 20:12:37.921897 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:37.921847    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn" podUID="0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731" containerName="payload-processing" containerID="cri-o://cd3d00c2641257adf9bfaf14cb455d7f1462ac46f1a3f941a1c863223cd91c9c" gracePeriod=30
Oct 30 20:12:38.013505 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.013470    6015 generic.go:356] "Generic (PLEG): container finished" podID="58579da1-0c5e-49fa-a789-bddd688c9199" containerID="c036ed7304db7a3f60097ebefc6ddc6519b2d1776ee149555ad51c1685cba10b" exitCode=0
Oct 30 20:12:38.013895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.013536    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj" event={"ID":"58579da1-0c5e-49fa-a789-bddd688c9199","Type":"ContainerDied","Data":"c036ed7304db7a3f60097ebefc6ddc6519b2d1776ee149555ad51c1685cba10b"}
Oct 30 20:12:38.024849 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.021652    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"]
Oct 30 20:12:38.024849 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.021901    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq" podUID="6a37019c-fd55-43e6-a457-6f389275ebb6" containerName="payload-pre-processing" containerID="cri-o://0d47de205ad33abf4455c9af095e1ff04badf77ae80c68ddaffe78c9fc1bc3ed" gracePeriod=30
Oct 30 20:12:38.098837 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.098693    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:38.234182 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.234145    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:12:38.255626 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.255586    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:38.308360 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.308328    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:12:38.314461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.314429    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-kube-api-access-kjlgx\" (UniqueName: \"kubernetes.io/projected/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-kube-api-access-kjlgx\") pod \"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731\" (UID: \"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731\") "
Oct 30 20:12:38.314618 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.314525    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-plugins-config-volume\") pod \"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731\" (UID: \"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731\") "
Oct 30 20:12:38.314951 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.314926    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-plugins-config-volume" pod "0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731" (UID: "0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:12:38.315145 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.315127    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:38.316868 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.316836    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-kube-api-access-kjlgx" pod "0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731" (UID: "0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731"). InnerVolumeSpecName "kube-api-access-kjlgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:12:38.416357 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.416320    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a37019c-fd55-43e6-a457-6f389275ebb6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a37019c-fd55-43e6-a457-6f389275ebb6-plugins-config-volume\") pod \"6a37019c-fd55-43e6-a457-6f389275ebb6\" (UID: \"6a37019c-fd55-43e6-a457-6f389275ebb6\") "
Oct 30 20:12:38.416559 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.416467    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a37019c-fd55-43e6-a457-6f389275ebb6-kube-api-access-pdrp9\" (UniqueName: \"kubernetes.io/projected/6a37019c-fd55-43e6-a457-6f389275ebb6-kube-api-access-pdrp9\") pod \"6a37019c-fd55-43e6-a457-6f389275ebb6\" (UID: \"6a37019c-fd55-43e6-a457-6f389275ebb6\") "
Oct 30 20:12:38.416861 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.416790    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a37019c-fd55-43e6-a457-6f389275ebb6-plugins-config-volume" pod "6a37019c-fd55-43e6-a457-6f389275ebb6" (UID: "6a37019c-fd55-43e6-a457-6f389275ebb6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:12:38.417113 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.417085    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a37019c-fd55-43e6-a457-6f389275ebb6-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:38.417235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.417116    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjlgx\" (UniqueName: \"kubernetes.io/projected/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731-kube-api-access-kjlgx\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:38.419247 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.419222    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a37019c-fd55-43e6-a457-6f389275ebb6-kube-api-access-pdrp9" pod "6a37019c-fd55-43e6-a457-6f389275ebb6" (UID: "6a37019c-fd55-43e6-a457-6f389275ebb6"). InnerVolumeSpecName "kube-api-access-pdrp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:12:38.501895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.498253    6015 scope.go:122] "RemoveContainer" containerID="cd3d00c2641257adf9bfaf14cb455d7f1462ac46f1a3f941a1c863223cd91c9c"
Oct 30 20:12:38.531348 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.519317    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdrp9\" (UniqueName: \"kubernetes.io/projected/6a37019c-fd55-43e6-a457-6f389275ebb6-kube-api-access-pdrp9\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:38.558971 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:38.558941    6015 scope.go:122] "RemoveContainer" containerID="0d47de205ad33abf4455c9af095e1ff04badf77ae80c68ddaffe78c9fc1bc3ed"
Oct 30 20:12:39.020881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.020842    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq" event={"ID":"6a37019c-fd55-43e6-a457-6f389275ebb6","Type":"ContainerDied","Data":"0d47de205ad33abf4455c9af095e1ff04badf77ae80c68ddaffe78c9fc1bc3ed"}
Oct 30 20:12:39.021277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.020909    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq" event={"ID":"6a37019c-fd55-43e6-a457-6f389275ebb6","Type":"ContainerDied","Data":"a8a95c484809f668e3aa149f176f2aa37566500f8eb3cd7d4161605d30313e9a"}
Oct 30 20:12:39.021277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.020928    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn" event={"ID":"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731","Type":"ContainerDied","Data":"cd3d00c2641257adf9bfaf14cb455d7f1462ac46f1a3f941a1c863223cd91c9c"}
Oct 30 20:12:39.021277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.020974    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn" event={"ID":"0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731","Type":"ContainerDied","Data":"2f5a0efe37b29d97a3632b8f9694a4e43984f704ef6effa8206b50d9d4f8aa0e"}
Oct 30 20:12:39.021277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.020992    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"
Oct 30 20:12:39.021459 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.021306    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"
Oct 30 20:12:39.183874 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.183841    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:39.227928 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.227846    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-xks-ca\") pod \"58579da1-0c5e-49fa-a789-bddd688c9199\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") "
Oct 30 20:12:39.227928 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.227898    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58579da1-0c5e-49fa-a789-bddd688c9199-kube-api-access-9zrhf\" (UniqueName: \"kubernetes.io/projected/58579da1-0c5e-49fa-a789-bddd688c9199-kube-api-access-9zrhf\") pod \"58579da1-0c5e-49fa-a789-bddd688c9199\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") "
Oct 30 20:12:39.228160 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.228013    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-openshift-ca\") pod \"58579da1-0c5e-49fa-a789-bddd688c9199\" (UID: \"58579da1-0c5e-49fa-a789-bddd688c9199\") "
Oct 30 20:12:39.228341 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.228312    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-openshift-ca" pod "58579da1-0c5e-49fa-a789-bddd688c9199" (UID: "58579da1-0c5e-49fa-a789-bddd688c9199"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:12:39.228467 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.228450    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-openshift-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:39.230281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.230256    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58579da1-0c5e-49fa-a789-bddd688c9199-kube-api-access-9zrhf" pod "58579da1-0c5e-49fa-a789-bddd688c9199" (UID: "58579da1-0c5e-49fa-a789-bddd688c9199"). InnerVolumeSpecName "kube-api-access-9zrhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:12:39.230393 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.230349    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-xks-ca" pod "58579da1-0c5e-49fa-a789-bddd688c9199" (UID: "58579da1-0c5e-49fa-a789-bddd688c9199"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:12:39.242482 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.242454    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"]
Oct 30 20:12:39.289410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.289365    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaa6d2-55888df8c-8cklq"]
Oct 30 20:12:39.296178 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.296149    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:39.329796 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.329753    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/58579da1-0c5e-49fa-a789-bddd688c9199-maas-api-xks-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:39.329796 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.329791    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zrhf\" (UniqueName: \"kubernetes.io/projected/58579da1-0c5e-49fa-a789-bddd688c9199-kube-api-access-9zrhf\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:12:39.412302 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.412271    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"]
Oct 30 20:12:39.414913 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.414880    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaa6d2-68c7fdcd4-z5kzn"]
Oct 30 20:12:39.586830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.586607    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731" path="/var/lib/kubelet/pods/0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731/volumes"
Oct 30 20:12:39.587380 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.587355    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6a37019c-fd55-43e6-a457-6f389275ebb6" path="/var/lib/kubelet/pods/6a37019c-fd55-43e6-a457-6f389275ebb6/volumes"
Oct 30 20:12:39.659793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.659754    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:39.813597 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:39.813554    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:40.028845 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:40.028734    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"
Oct 30 20:12:40.028845 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:40.028774    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj" event={"ID":"58579da1-0c5e-49fa-a789-bddd688c9199","Type":"ContainerDied","Data":"7a6b19a6601b3fe16eea4cfa8f67fb1c20c837a21ab3d693f580e28d1db2e950"}
Oct 30 20:12:40.029276 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:40.028885    6015 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a6b19a6601b3fe16eea4cfa8f67fb1c20c837a21ab3d693f580e28d1db2e950"
Oct 30 20:12:40.371504 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:40.371466    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:45.157684 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:45.157641    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:45.421556 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:45.421463    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:47.498615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:47.498570    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:47.702032 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:47.701991    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:50.635854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:50.635798    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:54.965000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:54.964959    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:55.709597 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:12:55.709559    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:12:58.218051 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:12:58.218010    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:13:01.048712 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:01.048673    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:07.274156 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:07.274073    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:09.107915 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:09.107863    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:09.470555 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:09.470460    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:09.776042 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:09.775950    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:10.452131 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:10.452097    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:14.455679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:14.455639    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:16.493182 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:16.492968    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:16.649853 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:16.649817    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:16.827864 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:16.827787    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"]
Oct 30 20:13:16.828126 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:16.828096    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy" containerID="cri-o://42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198" gracePeriod=30
Oct 30 20:13:16.863427 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:16.863393    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:19.482592 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:19.482548    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:21.741469 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:21.741440    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:22.120430 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.120402    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:13:22.305850 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.305775    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istiod-ca-cert\") pod \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") "
Oct 30 20:13:22.306058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.305876    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-certs\") pod \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") "
Oct 30 20:13:22.306058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.305918    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-envoy\") pod \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") "
Oct 30 20:13:22.306058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306014    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-kube-api-access-l4s8c\" (UniqueName: \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-kube-api-access-l4s8c\") pod \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") "
Oct 30 20:13:22.306248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306087    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-podinfo\") pod \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") "
Oct 30 20:13:22.306248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306162    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-credential-socket\") pod \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") "
Oct 30 20:13:22.306248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306190    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-certs" pod "ad3c71a4-65a1-4529-b173-359e6c2fb3fd" (UID: "ad3c71a4-65a1-4529-b173-359e6c2fb3fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:22.306248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306218    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-socket\") pod \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") "
Oct 30 20:13:22.306248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306226    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istiod-ca-cert" pod "ad3c71a4-65a1-4529-b173-359e6c2fb3fd" (UID: "ad3c71a4-65a1-4529-b173-359e6c2fb3fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:13:22.306508 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306280    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-data\") pod \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") "
Oct 30 20:13:22.306508 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306330    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-token\" (UniqueName: \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-token\") pod \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\" (UID: \"ad3c71a4-65a1-4529-b173-359e6c2fb3fd\") "
Oct 30 20:13:22.306617 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306506    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-credential-socket" pod "ad3c71a4-65a1-4529-b173-359e6c2fb3fd" (UID: "ad3c71a4-65a1-4529-b173-359e6c2fb3fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:22.306672 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306613    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-socket" pod "ad3c71a4-65a1-4529-b173-359e6c2fb3fd" (UID: "ad3c71a4-65a1-4529-b173-359e6c2fb3fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:22.306728 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306698    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-data" pod "ad3c71a4-65a1-4529-b173-359e6c2fb3fd" (UID: "ad3c71a4-65a1-4529-b173-359e6c2fb3fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:22.306989 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306967    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:22.307069 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.306995    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:22.307069 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.307009    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:22.307069 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.307021    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:22.307069 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.307035    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:22.309437 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.309396    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-token" pod "ad3c71a4-65a1-4529-b173-359e6c2fb3fd" (UID: "ad3c71a4-65a1-4529-b173-359e6c2fb3fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:13:22.310012 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.309992    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-envoy" pod "ad3c71a4-65a1-4529-b173-359e6c2fb3fd" (UID: "ad3c71a4-65a1-4529-b173-359e6c2fb3fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:22.310119 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.310012    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-kube-api-access-l4s8c" pod "ad3c71a4-65a1-4529-b173-359e6c2fb3fd" (UID: "ad3c71a4-65a1-4529-b173-359e6c2fb3fd"). InnerVolumeSpecName "kube-api-access-l4s8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:13:22.316999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.316945    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-podinfo" pod "ad3c71a4-65a1-4529-b173-359e6c2fb3fd" (UID: "ad3c71a4-65a1-4529-b173-359e6c2fb3fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:13:22.322054 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.322020    6015 generic.go:356] "Generic (PLEG): container finished" podID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerID="42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198" exitCode=0
Oct 30 20:13:22.322282 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.322238    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" event={"ID":"ad3c71a4-65a1-4529-b173-359e6c2fb3fd","Type":"ContainerDied","Data":"42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198"}
Oct 30 20:13:22.322399 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.322292    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"
Oct 30 20:13:22.322399 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.322345    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6" event={"ID":"ad3c71a4-65a1-4529-b173-359e6c2fb3fd","Type":"ContainerDied","Data":"9e2d3a5f0fec657fc8efdea756c5c378e661a5fbca20285dbe65f4a331f1e9cc"}
Oct 30 20:13:22.322399 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.322395    6015 scope.go:122] "RemoveContainer" containerID="42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198"
Oct 30 20:13:22.344361 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.344341    6015 scope.go:122] "RemoveContainer" containerID="cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5"
Oct 30 20:13:22.359472 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.359447    6015 scope.go:122] "RemoveContainer" containerID="42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198"
Oct 30 20:13:22.359864 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:13:22.359835    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198\": container with ID starting with 42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198 not found: ID does not exist" containerID="42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198"
Oct 30 20:13:22.359976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.359878    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198"} err="failed to get container status \"42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198\": rpc error: code = NotFound desc = could not find container \"42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198\": container with ID starting with 42193b9b1a96b9e0a57f52566bdbcc5d7ab771ded482b6baa529fc15ea594198 not found: ID does not exist"
Oct 30 20:13:22.359976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.359901    6015 scope.go:122] "RemoveContainer" containerID="cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5"
Oct 30 20:13:22.360161 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:13:22.360142    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5\": container with ID starting with cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5 not found: ID does not exist" containerID="cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5"
Oct 30 20:13:22.360202 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.360168    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5"} err="failed to get container status \"cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5\": rpc error: code = NotFound desc = could not find container \"cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5\": container with ID starting with cef834494a81ff226bc38ffa3af4dd5f667a395a402498e6b5cdb65c0092f4e5 not found: ID does not exist"
Oct 30 20:13:22.408582 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.408547    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:22.408582 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.408577    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4s8c\" (UniqueName: \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-kube-api-access-l4s8c\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:22.408582 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.408587    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:22.408853 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.408596    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad3c71a4-65a1-4529-b173-359e6c2fb3fd-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:22.481738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.481702    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"]
Oct 30 20:13:22.528943 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.528898    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-praxis-b-115a78-openshift-default-664b49d565-rtnr6"]
Oct 30 20:13:22.979884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:22.979843    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:23.585415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:23.585378    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" path="/var/lib/kubelet/pods/ad3c71a4-65a1-4529-b173-359e6c2fb3fd/volumes"
Oct 30 20:13:24.514740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:24.514701    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:28.217020 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:13:28.216982    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:13:28.713094 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:28.713051    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:28.868098 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:28.868039    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:29.026323 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:29.026212    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"]
Oct 30 20:13:29.026908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:29.026871    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy" containerID="cri-o://bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f" gracePeriod=30
Oct 30 20:13:29.040546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:29.040495    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:29.617237 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:29.617199    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:34.303638 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.303566    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:13:34.355596 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.355564    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istiod-ca-cert\") pod \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") "
Oct 30 20:13:34.355791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.355617    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-data\") pod \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") "
Oct 30 20:13:34.355791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.355641    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-socket\") pod \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") "
Oct 30 20:13:34.355791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.355674    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-certs\") pod \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") "
Oct 30 20:13:34.355791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.355706    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-envoy\") pod \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") "
Oct 30 20:13:34.355791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.355790    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-podinfo\") pod \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") "
Oct 30 20:13:34.356093 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.355930    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-token\" (UniqueName: \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-token\") pod \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") "
Oct 30 20:13:34.356093 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.355993    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-data" pod "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" (UID: "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:34.356093 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.356084    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-kube-api-access-sx8k5\" (UniqueName: \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-kube-api-access-sx8k5\") pod \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") "
Oct 30 20:13:34.356229 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.356090    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-socket" pod "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" (UID: "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:34.356229 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.356134    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-credential-socket\") pod \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\" (UID: \"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a\") "
Oct 30 20:13:34.356381 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.356039    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istiod-ca-cert" pod "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" (UID: "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:13:34.356381 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.356145    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-certs" pod "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" (UID: "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:34.356381 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.356368    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-credential-socket" pod "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" (UID: "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:34.356669 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.356647    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:34.356963 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.356675    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:34.356963 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.356690    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:34.356963 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.356703    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:34.356963 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.356717    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:34.358349 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.358318    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-kube-api-access-sx8k5" pod "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" (UID: "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a"). InnerVolumeSpecName "kube-api-access-sx8k5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:13:34.358475 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.358427    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-envoy" pod "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" (UID: "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:34.358759 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.358743    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-token" pod "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" (UID: "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:13:34.358759 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.358743    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-podinfo" pod "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" (UID: "ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:13:34.397286 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.397250    6015 generic.go:356] "Generic (PLEG): container finished" podID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerID="bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f" exitCode=0
Oct 30 20:13:34.397488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.397289    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" event={"ID":"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a","Type":"ContainerDied","Data":"bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f"}
Oct 30 20:13:34.397488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.397310    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"
Oct 30 20:13:34.397488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.397381    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9" event={"ID":"ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a","Type":"ContainerDied","Data":"bc39f2e6febb303c8e60b8b63fe8bf185b327bdac04ddc9f49dfa951c3cb7e3f"}
Oct 30 20:13:34.397488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.397409    6015 scope.go:122] "RemoveContainer" containerID="bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f"
Oct 30 20:13:34.410103 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.410081    6015 scope.go:122] "RemoveContainer" containerID="22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02"
Oct 30 20:13:34.419591 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.419568    6015 scope.go:122] "RemoveContainer" containerID="bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f"
Oct 30 20:13:34.419927 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:13:34.419903    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f\": container with ID starting with bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f not found: ID does not exist" containerID="bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f"
Oct 30 20:13:34.420003 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.419938    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f"} err="failed to get container status \"bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f\": rpc error: code = NotFound desc = could not find container \"bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f\": container with ID starting with bea0cea9e7343b907067ba39fdb00fdeb40ea53ea84275e32c5ae12a109e276f not found: ID does not exist"
Oct 30 20:13:34.420003 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.419958    6015 scope.go:122] "RemoveContainer" containerID="22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02"
Oct 30 20:13:34.420248 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:13:34.420226    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02\": container with ID starting with 22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02 not found: ID does not exist" containerID="22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02"
Oct 30 20:13:34.420294 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.420249    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02"} err="failed to get container status \"22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02\": rpc error: code = NotFound desc = could not find container \"22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02\": container with ID starting with 22f2cc5e9b3a36fd282de6974e592513738e563ea5af6663094f9bd30eb1cd02 not found: ID does not exist"
Oct 30 20:13:34.458149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.458111    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:34.458149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.458148    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx8k5\" (UniqueName: \"kubernetes.io/projected/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-kube-api-access-sx8k5\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:34.458149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.458159    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:34.458397 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.458168    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:34.619288 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.619193    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"]
Oct 30 20:13:34.666517 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:34.666480    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-eaa6d2-openshift-default-5b6bdcb4b5-pv9x9"]
Oct 30 20:13:35.113330 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:35.113296    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:35.586900 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:35.586865    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" path="/var/lib/kubelet/pods/ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a/volumes"
Oct 30 20:13:40.186650 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:40.186606    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:44.383871 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:44.383779    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:45.881701 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:45.881669    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:46.098450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:46.098359    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:46.269546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:46.269462    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:46.411329 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:46.411293    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"]
Oct 30 20:13:46.457717 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:46.457678    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-a3c171-7fscj"]
Oct 30 20:13:46.918940 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:46.918898    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:47.591162 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:47.591126    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58579da1-0c5e-49fa-a789-bddd688c9199" path="/var/lib/kubelet/pods/58579da1-0c5e-49fa-a789-bddd688c9199/volumes"
Oct 30 20:13:51.159309 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:51.159266    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:53.905073 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:53.905032    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:54.162151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:54.162051    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:54.322402 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:54.322360    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"]
Oct 30 20:13:54.322682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:54.322586    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy" containerID="cri-o://4ec7515e6a82a2b2d31744aab3325a280928e4e53d38be0d94cb7077ac6e6a55" gracePeriod=30
Oct 30 20:13:54.336482 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:54.336448    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:55.300860 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:55.300820    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:55.958370 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:55.958328    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:13:58.218068 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:13:58.218022    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:13:59.567871 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.567833    6015 generic.go:356] "Generic (PLEG): container finished" podID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerID="4ec7515e6a82a2b2d31744aab3325a280928e4e53d38be0d94cb7077ac6e6a55" exitCode=0
Oct 30 20:13:59.568314 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.567908    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" event={"ID":"a3f68b4b-340c-40a9-a440-2ba4a6c417dd","Type":"ContainerDied","Data":"4ec7515e6a82a2b2d31744aab3325a280928e4e53d38be0d94cb7077ac6e6a55"}
Oct 30 20:13:59.568314 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.567988    6015 scope.go:122] "RemoveContainer" containerID="ada75a4a0321c2c4c901df2c5a00b435b3e5872e0fbf91536dac7b6f54d4b8b2"
Oct 30 20:13:59.619881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.619852    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:13:59.675474 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.675433    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-token\" (UniqueName: \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-token\") pod \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") "
Oct 30 20:13:59.675695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.675501    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-certs\") pod \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") "
Oct 30 20:13:59.675695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.675544    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-envoy\") pod \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") "
Oct 30 20:13:59.675695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.675596    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-socket\") pod \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") "
Oct 30 20:13:59.675695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.675649    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istiod-ca-cert\") pod \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") "
Oct 30 20:13:59.675695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.675680    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-credential-socket\") pod \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") "
Oct 30 20:13:59.676000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.675715    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-data\") pod \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") "
Oct 30 20:13:59.676000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.675767    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-kube-api-access-lktlv\" (UniqueName: \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-kube-api-access-lktlv\") pod \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") "
Oct 30 20:13:59.676000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.675850    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-podinfo\") pod \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\" (UID: \"a3f68b4b-340c-40a9-a440-2ba4a6c417dd\") "
Oct 30 20:13:59.676000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.675907    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-certs" pod "a3f68b4b-340c-40a9-a440-2ba4a6c417dd" (UID: "a3f68b4b-340c-40a9-a440-2ba4a6c417dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:59.676197 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.676108    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-data" pod "a3f68b4b-340c-40a9-a440-2ba4a6c417dd" (UID: "a3f68b4b-340c-40a9-a440-2ba4a6c417dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:59.676312 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.676283    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-credential-socket" pod "a3f68b4b-340c-40a9-a440-2ba4a6c417dd" (UID: "a3f68b4b-340c-40a9-a440-2ba4a6c417dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:59.676386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.676310    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istiod-ca-cert" pod "a3f68b4b-340c-40a9-a440-2ba4a6c417dd" (UID: "a3f68b4b-340c-40a9-a440-2ba4a6c417dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:13:59.676591 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.676565    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:59.676682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.676594    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:59.676770 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.676703    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:59.677035 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.676785    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:59.677035 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.676998    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-socket" pod "a3f68b4b-340c-40a9-a440-2ba4a6c417dd" (UID: "a3f68b4b-340c-40a9-a440-2ba4a6c417dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:59.678415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.678380    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-envoy" pod "a3f68b4b-340c-40a9-a440-2ba4a6c417dd" (UID: "a3f68b4b-340c-40a9-a440-2ba4a6c417dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:13:59.678722 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.678685    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-podinfo" pod "a3f68b4b-340c-40a9-a440-2ba4a6c417dd" (UID: "a3f68b4b-340c-40a9-a440-2ba4a6c417dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:13:59.680042 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.680010    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-kube-api-access-lktlv" pod "a3f68b4b-340c-40a9-a440-2ba4a6c417dd" (UID: "a3f68b4b-340c-40a9-a440-2ba4a6c417dd"). InnerVolumeSpecName "kube-api-access-lktlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:13:59.680164 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.680126    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-token" pod "a3f68b4b-340c-40a9-a440-2ba4a6c417dd" (UID: "a3f68b4b-340c-40a9-a440-2ba4a6c417dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:13:59.777710 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.777671    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:59.777710 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.777699    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:59.777710 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.777712    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:59.777710 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.777721    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lktlv\" (UniqueName: \"kubernetes.io/projected/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-kube-api-access-lktlv\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:13:59.778107 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:13:59.777731    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3f68b4b-340c-40a9-a440-2ba4a6c417dd-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:00.016763 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.016672    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:00.332889 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.332854    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"]
Oct 30 20:14:00.333137 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.333093    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp" podUID="50b86726-1ec5-4ad0-9b6e-9e12b6718eec" containerName="payload-processing" containerID="cri-o://20a62942e5947599f23b2fd9805f24b549553def342f1ef5e3878c768beb8816" gracePeriod=30
Oct 30 20:14:00.431349 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.431312    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"]
Oct 30 20:14:00.431545 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.431516    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s" podUID="d384d99a-2ed0-4867-acd8-8881424785c7" containerName="payload-pre-processing" containerID="cri-o://4d5b9b91b1f904f8038588d7df34b6421e46000b78fef9971c198064fb590837" gracePeriod=30
Oct 30 20:14:00.496775 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.496678    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:00.585279 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.585162    6015 generic.go:356] "Generic (PLEG): container finished" podID="50b86726-1ec5-4ad0-9b6e-9e12b6718eec" containerID="20a62942e5947599f23b2fd9805f24b549553def342f1ef5e3878c768beb8816" exitCode=0
Oct 30 20:14:00.585932 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.585283    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp" event={"ID":"50b86726-1ec5-4ad0-9b6e-9e12b6718eec","Type":"ContainerDied","Data":"20a62942e5947599f23b2fd9805f24b549553def342f1ef5e3878c768beb8816"}
Oct 30 20:14:00.588750 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.587702    6015 generic.go:356] "Generic (PLEG): container finished" podID="d384d99a-2ed0-4867-acd8-8881424785c7" containerID="4d5b9b91b1f904f8038588d7df34b6421e46000b78fef9971c198064fb590837" exitCode=0
Oct 30 20:14:00.588750 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.587943    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s" event={"ID":"d384d99a-2ed0-4867-acd8-8881424785c7","Type":"ContainerDied","Data":"4d5b9b91b1f904f8038588d7df34b6421e46000b78fef9971c198064fb590837"}
Oct 30 20:14:00.592417 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.592386    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j" event={"ID":"a3f68b4b-340c-40a9-a440-2ba4a6c417dd","Type":"ContainerDied","Data":"d1b20c0cd258e0f5e84c584eecd121bd3249db0c12cec454b88fbd019d031ab0"}
Oct 30 20:14:00.592582 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.592451    6015 scope.go:122] "RemoveContainer" containerID="4ec7515e6a82a2b2d31744aab3325a280928e4e53d38be0d94cb7077ac6e6a55"
Oct 30 20:14:00.592664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.592610    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"
Oct 30 20:14:00.655309 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.654668    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:14:00.662436 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.662293    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:00.727692 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.727667    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:14:00.760923 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.760893    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"]
Oct 30 20:14:00.791603 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.791565    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d384d99a-2ed0-4867-acd8-8881424785c7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d384d99a-2ed0-4867-acd8-8881424785c7-plugins-config-volume\") pod \"d384d99a-2ed0-4867-acd8-8881424785c7\" (UID: \"d384d99a-2ed0-4867-acd8-8881424785c7\") "
Oct 30 20:14:00.791603 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.791604    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d384d99a-2ed0-4867-acd8-8881424785c7-kube-api-access-pbvm9\" (UniqueName: \"kubernetes.io/projected/d384d99a-2ed0-4867-acd8-8881424785c7-kube-api-access-pbvm9\") pod \"d384d99a-2ed0-4867-acd8-8881424785c7\" (UID: \"d384d99a-2ed0-4867-acd8-8881424785c7\") "
Oct 30 20:14:00.791853 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.791663    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-kube-api-access-r4vz2\" (UniqueName: \"kubernetes.io/projected/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-kube-api-access-r4vz2\") pod \"50b86726-1ec5-4ad0-9b6e-9e12b6718eec\" (UID: \"50b86726-1ec5-4ad0-9b6e-9e12b6718eec\") "
Oct 30 20:14:00.791853 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.791795    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-plugins-config-volume\") pod \"50b86726-1ec5-4ad0-9b6e-9e12b6718eec\" (UID: \"50b86726-1ec5-4ad0-9b6e-9e12b6718eec\") "
Oct 30 20:14:00.792121 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.792081    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d384d99a-2ed0-4867-acd8-8881424785c7-plugins-config-volume" pod "d384d99a-2ed0-4867-acd8-8881424785c7" (UID: "d384d99a-2ed0-4867-acd8-8881424785c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:14:00.792242 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.792150    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-plugins-config-volume" pod "50b86726-1ec5-4ad0-9b6e-9e12b6718eec" (UID: "50b86726-1ec5-4ad0-9b6e-9e12b6718eec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:14:00.792504 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.792479    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:00.792591 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.792510    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d384d99a-2ed0-4867-acd8-8881424785c7-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:00.794155 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.794132    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d384d99a-2ed0-4867-acd8-8881424785c7-kube-api-access-pbvm9" pod "d384d99a-2ed0-4867-acd8-8881424785c7" (UID: "d384d99a-2ed0-4867-acd8-8881424785c7"). InnerVolumeSpecName "kube-api-access-pbvm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:14:00.794237 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.794172    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-kube-api-access-r4vz2" pod "50b86726-1ec5-4ad0-9b6e-9e12b6718eec" (UID: "50b86726-1ec5-4ad0-9b6e-9e12b6718eec"). InnerVolumeSpecName "kube-api-access-r4vz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:14:00.807405 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.807377    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-praxis-b-a3c171-openshift-default-5b5d48b545-zsm6j"]
Oct 30 20:14:00.894207 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.894112    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4vz2\" (UniqueName: \"kubernetes.io/projected/50b86726-1ec5-4ad0-9b6e-9e12b6718eec-kube-api-access-r4vz2\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:00.894207 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:00.894161    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbvm9\" (UniqueName: \"kubernetes.io/projected/d384d99a-2ed0-4867-acd8-8881424785c7-kube-api-access-pbvm9\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:01.539717 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.539679    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:01.552722 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.552683    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp" podUID="50b86726-1ec5-4ad0-9b6e-9e12b6718eec" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.120:9004: i/o timeout"
Oct 30 20:14:01.584491 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.584446    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" path="/var/lib/kubelet/pods/a3f68b4b-340c-40a9-a440-2ba4a6c417dd/volumes"
Oct 30 20:14:01.601174 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.601115    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"
Oct 30 20:14:01.601533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.601113    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp" event={"ID":"50b86726-1ec5-4ad0-9b6e-9e12b6718eec","Type":"ContainerDied","Data":"6fed3739f234d14fb6d24dd02febba74b625e565b48f99cf12bd5d19283540f9"}
Oct 30 20:14:01.601533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.601257    6015 scope.go:122] "RemoveContainer" containerID="20a62942e5947599f23b2fd9805f24b549553def342f1ef5e3878c768beb8816"
Oct 30 20:14:01.603411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.603387    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s" event={"ID":"d384d99a-2ed0-4867-acd8-8881424785c7","Type":"ContainerDied","Data":"8ce378f42e60d7ba4893df99d7d76335ff40188e687eeb9dcafe736ce8dad659"}
Oct 30 20:14:01.603505 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.603485    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"
Oct 30 20:14:01.613563 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.613540    6015 scope.go:122] "RemoveContainer" containerID="4d5b9b91b1f904f8038588d7df34b6421e46000b78fef9971c198064fb590837"
Oct 30 20:14:01.757031 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.757001    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"]
Oct 30 20:14:01.763759 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.763728    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c60685-84694f8d48-hpqxp"]
Oct 30 20:14:01.771352 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.771321    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:01.911967 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.906038    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"]
Oct 30 20:14:01.911967 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.908061    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c60685-cb95f5b7-xft6s"]
Oct 30 20:14:01.925227 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:01.925190    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:02.087850 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:02.087784    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:02.437745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:02.437697    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:03.586436 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:03.586397    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50b86726-1ec5-4ad0-9b6e-9e12b6718eec" path="/var/lib/kubelet/pods/50b86726-1ec5-4ad0-9b6e-9e12b6718eec/volumes"
Oct 30 20:14:03.587011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:03.586993    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d384d99a-2ed0-4867-acd8-8881424785c7" path="/var/lib/kubelet/pods/d384d99a-2ed0-4867-acd8-8881424785c7/volumes"
Oct 30 20:14:06.840904 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:06.840863    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:08.876233 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:08.876199    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:09.085346 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:09.085308    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:09.250056 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:09.249937    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:10.758318 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:10.758278    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:11.312323 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312276    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"]
Oct 30 20:14:11.312868 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312853    6015 cpu_manager.go:414] "containerMap: removing container" podUID="6a37019c-fd55-43e6-a457-6f389275ebb6" containerName="payload-pre-processing"
Oct 30 20:14:11.312933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312869    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6a37019c-fd55-43e6-a457-6f389275ebb6" containerName="payload-pre-processing"
Oct 30 20:14:11.312933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312881    6015 cpu_manager.go:414] "containerMap: removing container" podUID="50b86726-1ec5-4ad0-9b6e-9e12b6718eec" containerName="payload-processing"
Oct 30 20:14:11.312933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312886    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50b86726-1ec5-4ad0-9b6e-9e12b6718eec" containerName="payload-processing"
Oct 30 20:14:11.312933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312899    6015 cpu_manager.go:414] "containerMap: removing container" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy"
Oct 30 20:14:11.312933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312904    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy"
Oct 30 20:14:11.312933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312925    6015 cpu_manager.go:414] "containerMap: removing container" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy"
Oct 30 20:14:11.312933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312931    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312938    6015 cpu_manager.go:414] "containerMap: removing container" podUID="58579da1-0c5e-49fa-a789-bddd688c9199" containerName="revoke-keys"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312943    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58579da1-0c5e-49fa-a789-bddd688c9199" containerName="revoke-keys"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312951    6015 cpu_manager.go:414] "containerMap: removing container" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312955    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312960    6015 cpu_manager.go:414] "containerMap: removing container" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312965    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312974    6015 cpu_manager.go:414] "containerMap: removing container" podUID="0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731" containerName="payload-processing"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312979    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731" containerName="payload-processing"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312990    6015 cpu_manager.go:414] "containerMap: removing container" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.312994    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313002    6015 cpu_manager.go:414] "containerMap: removing container" podUID="d384d99a-2ed0-4867-acd8-8881424785c7" containerName="payload-pre-processing"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313007    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d384d99a-2ed0-4867-acd8-8881424785c7" containerName="payload-pre-processing"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313019    6015 cpu_manager.go:414] "containerMap: removing container" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313024    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313093    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313100    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="58579da1-0c5e-49fa-a789-bddd688c9199" containerName="revoke-keys"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313108    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313114    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c71fd0e-cdb3-48dc-94f8-c5a33f3b6731" containerName="payload-processing"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313122    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313131    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="d384d99a-2ed0-4867-acd8-8881424785c7" containerName="payload-pre-processing"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313142    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="ccc8f7e8-5437-4ad2-bbc8-ceeabf5e739a" containerName="istio-proxy"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313153    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="6a37019c-fd55-43e6-a457-6f389275ebb6" containerName="payload-pre-processing"
Oct 30 20:14:11.313172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.313161    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="50b86726-1ec5-4ad0-9b6e-9e12b6718eec" containerName="payload-processing"
Oct 30 20:14:11.316976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.316950    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.338452 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.338398    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-envoy\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.338651 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.338470    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-podinfo\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.338651 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.338591    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-token\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.338782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.338682    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-data\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.338782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.338729    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-socket\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.338782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.338753    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-credential-socket\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.338986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.338882    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-certs\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.338986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.338910    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8mg4\" (UniqueName: \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-kube-api-access-q8mg4\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.338986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.338948    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istiod-ca-cert\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.371197 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.371163    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-praxis-a-d5d3ba-openshift-default-dockercfg-gkdrh\""
Oct 30 20:14:11.420663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.420629    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"]
Oct 30 20:14:11.440250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.440216    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8mg4\" (UniqueName: \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-kube-api-access-q8mg4\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.440250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.440261    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istiod-ca-cert\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.440496 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.440333    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-envoy\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.440496 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.440369    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-podinfo\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.440496 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.440449    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-token\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.440496 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.440472    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-data\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.440496 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.440494    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-socket\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.440762 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.440511    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-credential-socket\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.440762 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.440566    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-certs\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.440912 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.440899    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-credential-socket\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.441167 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.441137    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-data\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.441263 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.441205    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istiod-ca-cert\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.441425 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.441402    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-socket\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.441692 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.441673    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-certs\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.442990 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.442964    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-envoy\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.443392 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.443373    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-podinfo\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.470979 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.470942    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:11.499677 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.499636    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-token\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.499883 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.499693    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8mg4\" (UniqueName: \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-kube-api-access-q8mg4\") pod \"e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") " pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.639743 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.639654    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:11.754898 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.754609    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:11.913382 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:11.913304    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:12.075211 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.075173    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"]
Oct 30 20:14:12.080913 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:14:12.080882    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b83e30_b72d_43b2_a980_b3fcf111d8d7.slice/crio-4a1bb1ac257f19eca69181bac097bacca80d0c36a901e7a06b7da336e1a4446a WatchSource:0}: Error finding container 4a1bb1ac257f19eca69181bac097bacca80d0c36a901e7a06b7da336e1a4446a: Status 404 returned error can't find the container with id 4a1bb1ac257f19eca69181bac097bacca80d0c36a901e7a06b7da336e1a4446a
Oct 30 20:14:12.083410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.083376    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:14:12.083499 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.083445    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:14:12.083499 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.083472    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:14:12.638795 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.638761    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"]
Oct 30 20:14:12.639492 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.639472    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3f68b4b-340c-40a9-a440-2ba4a6c417dd" containerName="istio-proxy"
Oct 30 20:14:12.639492 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.639491    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad3c71a4-65a1-4529-b173-359e6c2fb3fd" containerName="istio-proxy"
Oct 30 20:14:12.643341 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.643315    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.685354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.685308    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" event={"ID":"f5b83e30-b72d-43b2-a980-b3fcf111d8d7","Type":"ContainerStarted","Data":"321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2"}
Oct 30 20:14:12.685536 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.685369    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" event={"ID":"f5b83e30-b72d-43b2-a980-b3fcf111d8d7","Type":"ContainerStarted","Data":"4a1bb1ac257f19eca69181bac097bacca80d0c36a901e7a06b7da336e1a4446a"}
Oct 30 20:14:12.694433 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.694401    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-a74d15-openshift-default-dockercfg-pfbt9\""
Oct 30 20:14:12.744122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.744084    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"]
Oct 30 20:14:12.760250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.760214    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-podinfo\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.760435 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.760335    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj9v7\" (UniqueName: \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-kube-api-access-hj9v7\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.760435 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.760420    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-token\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.760542 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.760459    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-envoy\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.760542 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.760484    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-credential-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.760640 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.760615    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-data\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.760770 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.760751    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istiod-ca-cert\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.761066 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.760997    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-certs\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.761255 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.761106    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.862770 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.862731    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istiod-ca-cert\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.862782    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-certs\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.862880    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.862945    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-podinfo\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.862985    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj9v7\" (UniqueName: \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-kube-api-access-hj9v7\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.863015    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-token\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863311 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.863235    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-envoy\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863311 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.863260    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-certs\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863311 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.863290    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-credential-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863460 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.863328    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-data\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863511 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.863479    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863639 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.863617    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-credential-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863702 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.863631    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istiod-ca-cert\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.863702 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.863686    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-data\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.865632 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.865606    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-envoy\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.865736 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.865692    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-podinfo\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.871965 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.871903    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" podStartSLOduration=1.8718849130000002 podStartE2EDuration="1.871884913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:14:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:14:12.87035745 +0000 UTC m=+2915.413164729" watchObservedRunningTime="2026-10-30 20:14:12.871884913 +0000 UTC m=+2915.414692178"
Oct 30 20:14:12.930435 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.930351    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-token\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.931901 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.931866    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj9v7\" (UniqueName: \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-kube-api-access-hj9v7\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:12.959621 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:12.959586    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:13.406655 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.406616    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"]
Oct 30 20:14:13.448515 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:14:13.448473    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef0f5d3_6a04_4b7f_9cd9_c5bbe873567a.slice/crio-2048aac7bb4903edd30293c0eb0fdeda332586814aeb52293b0ea553dfa64bdc WatchSource:0}: Error finding container 2048aac7bb4903edd30293c0eb0fdeda332586814aeb52293b0ea553dfa64bdc: Status 404 returned error can't find the container with id 2048aac7bb4903edd30293c0eb0fdeda332586814aeb52293b0ea553dfa64bdc
Oct 30 20:14:13.451225 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.451190    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:14:13.451335 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.451277    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:14:13.451404 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.451373    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:14:13.639839 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.639792    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:13.646149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.646112    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:13.694520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.694428    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" event={"ID":"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a","Type":"ContainerStarted","Data":"2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0"}
Oct 30 20:14:13.694520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.694489    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" event={"ID":"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a","Type":"ContainerStarted","Data":"2048aac7bb4903edd30293c0eb0fdeda332586814aeb52293b0ea553dfa64bdc"}
Oct 30 20:14:13.694724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.694669    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:13.695715 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.695694    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:14:13.913440 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.913375    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" podStartSLOduration=1.913360577 podStartE2EDuration="1.913360577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:14:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:14:13.911156059 +0000 UTC m=+2916.453963328" watchObservedRunningTime="2026-10-30 20:14:13.913360577 +0000 UTC m=+2916.456167841"
Oct 30 20:14:13.960378 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:13.960268    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:14.961468 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:14.961430    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused" start-of-body=
Oct 30 20:14:14.961968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:14.961496    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused"
Oct 30 20:14:15.911695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:15.911658    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:15.960349 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:15.960310    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused" start-of-body=
Oct 30 20:14:15.960549 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:15.960372    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused"
Oct 30 20:14:16.089967 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:16.089905    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:16.256499 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:16.256394    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:16.732778 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:16.732722    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:16.960548 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:16.960504    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused" start-of-body=
Oct 30 20:14:16.960733 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:16.960570    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused"
Oct 30 20:14:17.304605 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:17.304555    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:17.550411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:17.550373    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:17.960363 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:17.960329    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused" start-of-body=
Oct 30 20:14:17.960624 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:17.960593    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused"
Oct 30 20:14:18.960547 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:18.960509    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused" start-of-body=
Oct 30 20:14:18.961058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:18.960781    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused"
Oct 30 20:14:19.961096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:19.961056    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused" start-of-body=
Oct 30 20:14:19.961643 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:19.961127    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.127:15021/healthz/ready\": dial tcp 10.134.0.127:15021: connect: connection refused"
Oct 30 20:14:20.896453 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:20.896257    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:20.987145 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:20.987011    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:20.988027 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:20.988000    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:20.989415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:20.989387    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:14:21.074542 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:21.074481    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:21.243936 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:21.243844    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:22.642882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:22.642848    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:22.931147 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:22.931058    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:23.087797 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:23.087756    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:23.559731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:23.559692    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:27.964823 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:27.964767    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:28.215995 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:14:28.215908    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:14:29.860905 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:29.860862    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:30.037410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:30.037365    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:30.277888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:30.277764    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"]
Oct 30 20:14:30.278114 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:30.278066    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy" containerID="cri-o://23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8" gracePeriod=30
Oct 30 20:14:30.297462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:30.297412    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:32.774490 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:32.774451    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:35.586426 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.586395    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:14:35.699239 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699191    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-envoy\") pod \"9d6b6381-6e22-4028-b331-cdd94f5de7de\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") "
Oct 30 20:14:35.699447 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699314    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-credential-socket\") pod \"9d6b6381-6e22-4028-b331-cdd94f5de7de\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") "
Oct 30 20:14:35.699447 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699377    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-token\" (UniqueName: \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-token\") pod \"9d6b6381-6e22-4028-b331-cdd94f5de7de\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") "
Oct 30 20:14:35.699560 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699465    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-certs\") pod \"9d6b6381-6e22-4028-b331-cdd94f5de7de\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") "
Oct 30 20:14:35.699621 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699587    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-kube-api-access-cxrtj\" (UniqueName: \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-kube-api-access-cxrtj\") pod \"9d6b6381-6e22-4028-b331-cdd94f5de7de\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") "
Oct 30 20:14:35.699691 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699621    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-credential-socket" pod "9d6b6381-6e22-4028-b331-cdd94f5de7de" (UID: "9d6b6381-6e22-4028-b331-cdd94f5de7de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:14:35.699691 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699674    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-socket\") pod \"9d6b6381-6e22-4028-b331-cdd94f5de7de\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") "
Oct 30 20:14:35.699793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699709    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d6b6381-6e22-4028-b331-cdd94f5de7de-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d6b6381-6e22-4028-b331-cdd94f5de7de-istiod-ca-cert\") pod \"9d6b6381-6e22-4028-b331-cdd94f5de7de\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") "
Oct 30 20:14:35.699793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699725    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-certs" pod "9d6b6381-6e22-4028-b331-cdd94f5de7de" (UID: "9d6b6381-6e22-4028-b331-cdd94f5de7de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:14:35.699793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699763    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-podinfo\") pod \"9d6b6381-6e22-4028-b331-cdd94f5de7de\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") "
Oct 30 20:14:35.700057 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699797    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-data\") pod \"9d6b6381-6e22-4028-b331-cdd94f5de7de\" (UID: \"9d6b6381-6e22-4028-b331-cdd94f5de7de\") "
Oct 30 20:14:35.700057 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.699958    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-socket" pod "9d6b6381-6e22-4028-b331-cdd94f5de7de" (UID: "9d6b6381-6e22-4028-b331-cdd94f5de7de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:14:35.700444 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.700366    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:35.700444 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.700390    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:35.700444 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.700406    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:35.700444 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.700408    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d6b6381-6e22-4028-b331-cdd94f5de7de-istiod-ca-cert" pod "9d6b6381-6e22-4028-b331-cdd94f5de7de" (UID: "9d6b6381-6e22-4028-b331-cdd94f5de7de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:14:35.700739 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.700627    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-data" pod "9d6b6381-6e22-4028-b331-cdd94f5de7de" (UID: "9d6b6381-6e22-4028-b331-cdd94f5de7de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:14:35.701908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.701880    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-envoy" pod "9d6b6381-6e22-4028-b331-cdd94f5de7de" (UID: "9d6b6381-6e22-4028-b331-cdd94f5de7de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:14:35.702242 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.702216    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-kube-api-access-cxrtj" pod "9d6b6381-6e22-4028-b331-cdd94f5de7de" (UID: "9d6b6381-6e22-4028-b331-cdd94f5de7de"). InnerVolumeSpecName "kube-api-access-cxrtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:14:35.702467 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.702442    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-token" pod "9d6b6381-6e22-4028-b331-cdd94f5de7de" (UID: "9d6b6381-6e22-4028-b331-cdd94f5de7de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:14:35.702912 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.702884    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-podinfo" pod "9d6b6381-6e22-4028-b331-cdd94f5de7de" (UID: "9d6b6381-6e22-4028-b331-cdd94f5de7de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:14:35.801690 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.801642    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:35.801690 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.801692    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxrtj\" (UniqueName: \"kubernetes.io/projected/9d6b6381-6e22-4028-b331-cdd94f5de7de-kube-api-access-cxrtj\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:35.801917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.801709    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d6b6381-6e22-4028-b331-cdd94f5de7de-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:35.801917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.801722    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:35.801917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.801736    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:35.801917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.801749    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d6b6381-6e22-4028-b331-cdd94f5de7de-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:14:35.851029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.850931    6015 generic.go:356] "Generic (PLEG): container finished" podID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerID="23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8" exitCode=0
Oct 30 20:14:35.851029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.850986    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"
Oct 30 20:14:35.851210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.851025    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" event={"ID":"9d6b6381-6e22-4028-b331-cdd94f5de7de","Type":"ContainerDied","Data":"23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8"}
Oct 30 20:14:35.851210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.851124    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn" event={"ID":"9d6b6381-6e22-4028-b331-cdd94f5de7de","Type":"ContainerDied","Data":"278b87aec37f38915a077859b5c22bc0b0a00761e35fef4d29698cc6037c418d"}
Oct 30 20:14:35.851210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.851148    6015 scope.go:122] "RemoveContainer" containerID="23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8"
Oct 30 20:14:35.862206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.862183    6015 scope.go:122] "RemoveContainer" containerID="aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d"
Oct 30 20:14:35.871351 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.871322    6015 scope.go:122] "RemoveContainer" containerID="23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8"
Oct 30 20:14:35.871669 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:14:35.871641    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8\": container with ID starting with 23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8 not found: ID does not exist" containerID="23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8"
Oct 30 20:14:35.871745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.871680    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8"} err="failed to get container status \"23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8\": rpc error: code = NotFound desc = could not find container \"23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8\": container with ID starting with 23662f6a162b24432d2459f33c0586504039c6c68664c39f7384bb1b1ec922d8 not found: ID does not exist"
Oct 30 20:14:35.871745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.871699    6015 scope.go:122] "RemoveContainer" containerID="aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d"
Oct 30 20:14:35.871982 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:14:35.871967    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d\": container with ID starting with aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d not found: ID does not exist" containerID="aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d"
Oct 30 20:14:35.872029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:35.871988    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d"} err="failed to get container status \"aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d\": rpc error: code = NotFound desc = could not find container \"aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d\": container with ID starting with aab889382f03e96ae1cd8d2152377c5a005fa4822ed94a83afb1c52b727e8d9d not found: ID does not exist"
Oct 30 20:14:36.007552 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:36.007511    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"]
Oct 30 20:14:36.054051 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:36.054014    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-praxis-a-e6b14d-openshift-default-6c66666b69-r7wmn"]
Oct 30 20:14:37.452208 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:37.452173    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:37.586145 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:37.586106    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" path="/var/lib/kubelet/pods/9d6b6381-6e22-4028-b331-cdd94f5de7de/volumes"
Oct 30 20:14:42.118156 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:42.118119    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:43.018288 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:43.018250    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:43.228920 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:43.228880    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:46.786343 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:46.786303    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:51.356751 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:51.356714    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:55.283545 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:55.283489    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:55.652096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:55.652054    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:55.859932 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:55.859888    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:56.033850 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:14:56.033744    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:14:58.215637 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:14:58.215587    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:15:00.161304 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.161266    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"]
Oct 30 20:15:00.161838 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.161798    6015 cpu_manager.go:414] "containerMap: removing container" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy"
Oct 30 20:15:00.161838 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.161829    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy"
Oct 30 20:15:00.162002 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.161849    6015 cpu_manager.go:414] "containerMap: removing container" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy"
Oct 30 20:15:00.162002 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.161855    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy"
Oct 30 20:15:00.162002 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.161942    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy"
Oct 30 20:15:00.162002 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.161955    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d6b6381-6e22-4028-b331-cdd94f5de7de" containerName="istio-proxy"
Oct 30 20:15:00.167039 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.167014    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"
Oct 30 20:15:00.185886 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.185851    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"]
Oct 30 20:15:00.189991 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.189965    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"]
Oct 30 20:15:00.190147 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.190082    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"
Oct 30 20:15:00.193975 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.193952    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"
Oct 30 20:15:00.203785 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.203752    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj8wb\" (UniqueName: \"kubernetes.io/projected/ba5d2a73-346a-4a9f-bf78-f6ddab367184-kube-api-access-lj8wb\") pod \"maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs\" (UID: \"ba5d2a73-346a-4a9f-bf78-f6ddab367184\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"
Oct 30 20:15:00.203961 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.203937    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7xdg\" (UniqueName: \"kubernetes.io/projected/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-kube-api-access-h7xdg\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t\" (UID: \"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"
Oct 30 20:15:00.204045 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.204009    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t\" (UID: \"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"
Oct 30 20:15:00.204216 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.204193    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba5d2a73-346a-4a9f-bf78-f6ddab367184-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs\" (UID: \"ba5d2a73-346a-4a9f-bf78-f6ddab367184\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"
Oct 30 20:15:00.230205 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.230174    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kmwqm\""
Oct 30 20:15:00.268509 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.268473    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"]
Oct 30 20:15:00.306714 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.306642    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7xdg\" (UniqueName: \"kubernetes.io/projected/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-kube-api-access-h7xdg\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t\" (UID: \"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"
Oct 30 20:15:00.308533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.306725    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t\" (UID: \"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"
Oct 30 20:15:00.308533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.306796    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba5d2a73-346a-4a9f-bf78-f6ddab367184-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs\" (UID: \"ba5d2a73-346a-4a9f-bf78-f6ddab367184\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"
Oct 30 20:15:00.308533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.306948    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsrvd\" (UniqueName: \"kubernetes.io/projected/3b000358-231f-4cd4-ac45-6bba9fada34b-kube-api-access-qsrvd\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b\" (UID: \"3b000358-231f-4cd4-ac45-6bba9fada34b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"
Oct 30 20:15:00.308533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.307007    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b000358-231f-4cd4-ac45-6bba9fada34b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b\" (UID: \"3b000358-231f-4cd4-ac45-6bba9fada34b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"
Oct 30 20:15:00.308533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.307031    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj8wb\" (UniqueName: \"kubernetes.io/projected/ba5d2a73-346a-4a9f-bf78-f6ddab367184-kube-api-access-lj8wb\") pod \"maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs\" (UID: \"ba5d2a73-346a-4a9f-bf78-f6ddab367184\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"
Oct 30 20:15:00.308533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.308105    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t\" (UID: \"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"
Oct 30 20:15:00.308533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.308223    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba5d2a73-346a-4a9f-bf78-f6ddab367184-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs\" (UID: \"ba5d2a73-346a-4a9f-bf78-f6ddab367184\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"
Oct 30 20:15:00.330334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.329392    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"]
Oct 30 20:15:00.333011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.332982    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"]
Oct 30 20:15:00.366705 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.366667    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7xdg\" (UniqueName: \"kubernetes.io/projected/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-kube-api-access-h7xdg\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t\" (UID: \"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"
Oct 30 20:15:00.366927 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.366835    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj8wb\" (UniqueName: \"kubernetes.io/projected/ba5d2a73-346a-4a9f-bf78-f6ddab367184-kube-api-access-lj8wb\") pod \"maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs\" (UID: \"ba5d2a73-346a-4a9f-bf78-f6ddab367184\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"
Oct 30 20:15:00.408547 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.408503    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsrvd\" (UniqueName: \"kubernetes.io/projected/3b000358-231f-4cd4-ac45-6bba9fada34b-kube-api-access-qsrvd\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b\" (UID: \"3b000358-231f-4cd4-ac45-6bba9fada34b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"
Oct 30 20:15:00.408764 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.408578    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b000358-231f-4cd4-ac45-6bba9fada34b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b\" (UID: \"3b000358-231f-4cd4-ac45-6bba9fada34b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"
Oct 30 20:15:00.409406 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.409380    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b000358-231f-4cd4-ac45-6bba9fada34b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b\" (UID: \"3b000358-231f-4cd4-ac45-6bba9fada34b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"
Oct 30 20:15:00.467306 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.467229    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsrvd\" (UniqueName: \"kubernetes.io/projected/3b000358-231f-4cd4-ac45-6bba9fada34b-kube-api-access-qsrvd\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b\" (UID: \"3b000358-231f-4cd4-ac45-6bba9fada34b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"
Oct 30 20:15:00.482165 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.482106    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"
Oct 30 20:15:00.506697 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.506668    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"
Oct 30 20:15:00.513284 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.513250    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"
Oct 30 20:15:00.585151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.583139    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:00.877124 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.877080    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"]
Oct 30 20:15:00.883280 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:15:00.883247    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58769c7e_d2c0_48a4_b79f_6ca3b76e24bf.slice/crio-4b1fc99b3063352bf15d768d70b2a78cd63da98101dcc371f787cf98b2593951 WatchSource:0}: Error finding container 4b1fc99b3063352bf15d768d70b2a78cd63da98101dcc371f787cf98b2593951: Status 404 returned error can't find the container with id 4b1fc99b3063352bf15d768d70b2a78cd63da98101dcc371f787cf98b2593951
Oct 30 20:15:00.979800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.979751    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"]
Oct 30 20:15:00.985720 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:15:00.985684    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b000358_231f_4cd4_ac45_6bba9fada34b.slice/crio-63b8aa633b5588318b703ff055addc2dea50a8036b46cc7c9a8a30d2e3644c39 WatchSource:0}: Error finding container 63b8aa633b5588318b703ff055addc2dea50a8036b46cc7c9a8a30d2e3644c39: Status 404 returned error can't find the container with id 63b8aa633b5588318b703ff055addc2dea50a8036b46cc7c9a8a30d2e3644c39
Oct 30 20:15:00.989427 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:00.989399    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"]
Oct 30 20:15:00.997736 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:15:00.997707    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5d2a73_346a_4a9f_bf78_f6ddab367184.slice/crio-e4601f8712e03e357419e12fdd537343d9db5af398e5704b395c9022252bbdfb WatchSource:0}: Error finding container e4601f8712e03e357419e12fdd537343d9db5af398e5704b395c9022252bbdfb: Status 404 returned error can't find the container with id e4601f8712e03e357419e12fdd537343d9db5af398e5704b395c9022252bbdfb
Oct 30 20:15:01.014371 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:01.014330    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b" event={"ID":"3b000358-231f-4cd4-ac45-6bba9fada34b","Type":"ContainerStarted","Data":"63b8aa633b5588318b703ff055addc2dea50a8036b46cc7c9a8a30d2e3644c39"}
Oct 30 20:15:01.016148 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:01.016118    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t" event={"ID":"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf","Type":"ContainerStarted","Data":"4b1fc99b3063352bf15d768d70b2a78cd63da98101dcc371f787cf98b2593951"}
Oct 30 20:15:01.017489 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:01.017468    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs" event={"ID":"ba5d2a73-346a-4a9f-bf78-f6ddab367184","Type":"ContainerStarted","Data":"e4601f8712e03e357419e12fdd537343d9db5af398e5704b395c9022252bbdfb"}
Oct 30 20:15:02.025462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:02.025430    6015 generic.go:356] "Generic (PLEG): container finished" podID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerID="e6e1e13c0bf7b7770560881745ab2d095c306d1592ce7ea069a5170c3aaaefd8" exitCode=60
Oct 30 20:15:02.025903 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:02.025523    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t" event={"ID":"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf","Type":"ContainerDied","Data":"e6e1e13c0bf7b7770560881745ab2d095c306d1592ce7ea069a5170c3aaaefd8"}
Oct 30 20:15:02.025903 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:02.025786    6015 scope.go:122] "RemoveContainer" containerID="e6e1e13c0bf7b7770560881745ab2d095c306d1592ce7ea069a5170c3aaaefd8"
Oct 30 20:15:02.027254 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:02.027233    6015 generic.go:356] "Generic (PLEG): container finished" podID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerID="424474dd5c94192eaa4556b1092d98dc6efa8835b2233e6e4173ebe4c9d11eac" exitCode=60
Oct 30 20:15:02.027385 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:02.027349    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs" event={"ID":"ba5d2a73-346a-4a9f-bf78-f6ddab367184","Type":"ContainerDied","Data":"424474dd5c94192eaa4556b1092d98dc6efa8835b2233e6e4173ebe4c9d11eac"}
Oct 30 20:15:02.027523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:02.027510    6015 scope.go:122] "RemoveContainer" containerID="424474dd5c94192eaa4556b1092d98dc6efa8835b2233e6e4173ebe4c9d11eac"
Oct 30 20:15:02.029138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:02.029088    6015 generic.go:356] "Generic (PLEG): container finished" podID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerID="a738b568ca53239dad9e5178bc3dbdae1b87b311f76b9d83743bb14a064e5a00" exitCode=60
Oct 30 20:15:02.029206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:02.029152    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b" event={"ID":"3b000358-231f-4cd4-ac45-6bba9fada34b","Type":"ContainerDied","Data":"a738b568ca53239dad9e5178bc3dbdae1b87b311f76b9d83743bb14a064e5a00"}
Oct 30 20:15:02.029357 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:02.029342    6015 scope.go:122] "RemoveContainer" containerID="a738b568ca53239dad9e5178bc3dbdae1b87b311f76b9d83743bb14a064e5a00"
Oct 30 20:15:03.038581 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:03.038544    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b" event={"ID":"3b000358-231f-4cd4-ac45-6bba9fada34b","Type":"ContainerStarted","Data":"b34d49f6ecbaed1d74e119f105f1707f44c65569373b57d636f180921d68be4c"}
Oct 30 20:15:03.040567 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:03.040532    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t" event={"ID":"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf","Type":"ContainerStarted","Data":"3f8fe391e50afd00c22cb315d3f9d42ee3c24a65feb84c09b7425b40409ee7d1"}
Oct 30 20:15:03.042497 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:03.042474    6015 generic.go:356] "Generic (PLEG): container finished" podID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerID="61ce85fc76b42aadfcf1b3fee9726e0a9683bb02c1240702ec0f723d0c06eb16" exitCode=60
Oct 30 20:15:03.042603 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:03.042508    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs" event={"ID":"ba5d2a73-346a-4a9f-bf78-f6ddab367184","Type":"ContainerDied","Data":"61ce85fc76b42aadfcf1b3fee9726e0a9683bb02c1240702ec0f723d0c06eb16"}
Oct 30 20:15:03.042603 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:03.042543    6015 scope.go:122] "RemoveContainer" containerID="424474dd5c94192eaa4556b1092d98dc6efa8835b2233e6e4173ebe4c9d11eac"
Oct 30 20:15:03.042818 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:03.042785    6015 scope.go:122] "RemoveContainer" containerID="61ce85fc76b42aadfcf1b3fee9726e0a9683bb02c1240702ec0f723d0c06eb16"
Oct 30 20:15:03.043111 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:15:03.043087    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs_odh-ai-gateway-infra(ba5d2a73-346a-4a9f-bf78-f6ddab367184)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184"
Oct 30 20:15:03.151313 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:03.151264    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b" podStartSLOduration=3.151250582 podStartE2EDuration="3.151250582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:03.149297597 +0000 UTC m=+2965.692104862" watchObservedRunningTime="2026-10-30 20:15:03.151250582 +0000 UTC m=+2965.694057847"
Oct 30 20:15:03.369886 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:03.369797    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t" podStartSLOduration=3.36978294 podStartE2EDuration="3.36978294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:03.367737722 +0000 UTC m=+2965.910544987" watchObservedRunningTime="2026-10-30 20:15:03.36978294 +0000 UTC m=+2965.912590204"
Oct 30 20:15:04.059910 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:04.059862    6015 scope.go:122] "RemoveContainer" containerID="61ce85fc76b42aadfcf1b3fee9726e0a9683bb02c1240702ec0f723d0c06eb16"
Oct 30 20:15:04.060372 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:15:04.060217    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs_odh-ai-gateway-infra(ba5d2a73-346a-4a9f-bf78-f6ddab367184)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184"
Oct 30 20:15:04.061751 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:04.061727    6015 generic.go:356] "Generic (PLEG): container finished" podID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerID="b34d49f6ecbaed1d74e119f105f1707f44c65569373b57d636f180921d68be4c" exitCode=60
Oct 30 20:15:04.061884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:04.061824    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b" event={"ID":"3b000358-231f-4cd4-ac45-6bba9fada34b","Type":"ContainerDied","Data":"b34d49f6ecbaed1d74e119f105f1707f44c65569373b57d636f180921d68be4c"}
Oct 30 20:15:04.061947 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:04.061923    6015 scope.go:122] "RemoveContainer" containerID="a738b568ca53239dad9e5178bc3dbdae1b87b311f76b9d83743bb14a064e5a00"
Oct 30 20:15:04.062063 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:04.062043    6015 scope.go:122] "RemoveContainer" containerID="b34d49f6ecbaed1d74e119f105f1707f44c65569373b57d636f180921d68be4c"
Oct 30 20:15:04.062364 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:15:04.062337    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b_odh-ai-gateway-infra(3b000358-231f-4cd4-ac45-6bba9fada34b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b"
Oct 30 20:15:04.063907 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:04.063889    6015 generic.go:356] "Generic (PLEG): container finished" podID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerID="3f8fe391e50afd00c22cb315d3f9d42ee3c24a65feb84c09b7425b40409ee7d1" exitCode=60
Oct 30 20:15:04.064002 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:04.063934    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t" event={"ID":"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf","Type":"ContainerDied","Data":"3f8fe391e50afd00c22cb315d3f9d42ee3c24a65feb84c09b7425b40409ee7d1"}
Oct 30 20:15:04.064129 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:04.064118    6015 scope.go:122] "RemoveContainer" containerID="3f8fe391e50afd00c22cb315d3f9d42ee3c24a65feb84c09b7425b40409ee7d1"
Oct 30 20:15:04.064309 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:15:04.064293    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t_odh-ai-gateway-infra(58769c7e-d2c0-48a4-b79f-6ca3b76e24bf)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf"
Oct 30 20:15:04.074117 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:04.074091    6015 scope.go:122] "RemoveContainer" containerID="e6e1e13c0bf7b7770560881745ab2d095c306d1592ce7ea069a5170c3aaaefd8"
Oct 30 20:15:04.626428 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:04.626369    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:05.072991 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:05.072960    6015 scope.go:122] "RemoveContainer" containerID="b34d49f6ecbaed1d74e119f105f1707f44c65569373b57d636f180921d68be4c"
Oct 30 20:15:05.073462 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:15:05.073305    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b_odh-ai-gateway-infra(3b000358-231f-4cd4-ac45-6bba9fada34b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b"
Oct 30 20:15:05.074882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:05.074856    6015 scope.go:122] "RemoveContainer" containerID="3f8fe391e50afd00c22cb315d3f9d42ee3c24a65feb84c09b7425b40409ee7d1"
Oct 30 20:15:05.075225 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:15:05.075194    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t_odh-ai-gateway-infra(58769c7e-d2c0-48a4-b79f-6ca3b76e24bf)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf"
Oct 30 20:15:05.737235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:05.737205    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:06.176989 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:06.176949    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:06.481275 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:06.481193    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:07.112698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:07.112663    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:07.546999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:07.546964    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:07.770592 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:07.770553    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:08.302362 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:08.302321    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:12.156339 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:12.156306    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:13.152111 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.152071    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"]
Oct 30 20:15:13.157482 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.157455    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.229882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.226291    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6svk\" (UniqueName: \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-kube-api-access-v6svk\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.229882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.226353    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd76943-6db1-4796-90e6-b54c5df4949b-istiod-ca-cert\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.229882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.226400    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-data\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.229882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.226437    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-credential-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.229882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.226543    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-podinfo\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.229882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.226597    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.229882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.226676    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-envoy\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.229882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.226721    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-token\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.229882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.226772    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-certs\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.263903 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.257768    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"]
Oct 30 20:15:13.328603 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.328544    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-envoy\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.328863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.328621    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-token\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.328863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.328684    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-certs\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.328863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.328731    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6svk\" (UniqueName: \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-kube-api-access-v6svk\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.328863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.328766    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd76943-6db1-4796-90e6-b54c5df4949b-istiod-ca-cert\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.328863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.328827    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-data\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.328863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.328863    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-credential-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.329297 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.328973    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-podinfo\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.329297 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.329031    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.329481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.329452    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.329778 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.329750    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-certs\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.330103 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.329999    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-data\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.330218 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.330166    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-credential-socket\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.330687 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.330659    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd76943-6db1-4796-90e6-b54c5df4949b-istiod-ca-cert\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.332788 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.332740    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-envoy\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.333644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.333617    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-podinfo\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.402529 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.402427    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-token\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.403628 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.403555    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6svk\" (UniqueName: \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-kube-api-access-v6svk\") pod \"e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") " pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.404117 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.404030    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:13.480855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.480086    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:13.953347 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.953301    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"]
Oct 30 20:15:13.958229 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:15:13.958199    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd76943_6db1_4796_90e6_b54c5df4949b.slice/crio-690b604f12fb199daa635ece69f512aa7f2bfca7cf1d7beffeb3bd342657e478 WatchSource:0}: Error finding container 690b604f12fb199daa635ece69f512aa7f2bfca7cf1d7beffeb3bd342657e478: Status 404 returned error can't find the container with id 690b604f12fb199daa635ece69f512aa7f2bfca7cf1d7beffeb3bd342657e478
Oct 30 20:15:13.960638 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.960603    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:15:13.960717 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.960676    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:15:13.960717 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:13.960703    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:15:14.141564 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:14.141512    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" event={"ID":"9dd76943-6db1-4796-90e6-b54c5df4949b","Type":"ContainerStarted","Data":"e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1"}
Oct 30 20:15:14.141736 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:14.141591    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" event={"ID":"9dd76943-6db1-4796-90e6-b54c5df4949b","Type":"ContainerStarted","Data":"690b604f12fb199daa635ece69f512aa7f2bfca7cf1d7beffeb3bd342657e478"}
Oct 30 20:15:14.259738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:14.259621    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" podStartSLOduration=1.259606213 podStartE2EDuration="1.259606213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:15:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:15:14.257259598 +0000 UTC m=+2976.800066873" watchObservedRunningTime="2026-10-30 20:15:14.259606213 +0000 UTC m=+2976.802413477"
Oct 30 20:15:14.485831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:14.483906    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:15.251188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:15.251149    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:15.453549 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:15.453503    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:15.499834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:15.498962    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused" start-of-body=
Oct 30 20:15:15.499834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:15.499030    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused"
Oct 30 20:15:15.625840 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:15.625279    6015 scope.go:122] "RemoveContainer" containerID="61ce85fc76b42aadfcf1b3fee9726e0a9683bb02c1240702ec0f723d0c06eb16"
Oct 30 20:15:15.654065 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:15.654034    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:16.488833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:16.488343    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused" start-of-body=
Oct 30 20:15:16.488833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:16.488416    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused"
Oct 30 20:15:16.582929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:16.581099    6015 scope.go:122] "RemoveContainer" containerID="3f8fe391e50afd00c22cb315d3f9d42ee3c24a65feb84c09b7425b40409ee7d1"
Oct 30 20:15:17.099832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:17.098681    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:17.161986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:17.161680    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t" event={"ID":"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf","Type":"ContainerStarted","Data":"4efa23e013ff31557fef52bfed27798eb5b40966b24cd6b02469844238c866fa"}
Oct 30 20:15:17.163662 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:17.163638    6015 generic.go:356] "Generic (PLEG): container finished" podID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerID="e0679a21bd22fba252d419c6e2fcb493d9456a77fc9e2c048a361c9f9deb36f4" exitCode=60
Oct 30 20:15:17.163775 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:17.163680    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs" event={"ID":"ba5d2a73-346a-4a9f-bf78-f6ddab367184","Type":"ContainerDied","Data":"e0679a21bd22fba252d419c6e2fcb493d9456a77fc9e2c048a361c9f9deb36f4"}
Oct 30 20:15:17.163775 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:17.163715    6015 scope.go:122] "RemoveContainer" containerID="61ce85fc76b42aadfcf1b3fee9726e0a9683bb02c1240702ec0f723d0c06eb16"
Oct 30 20:15:17.164131 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:17.164098    6015 scope.go:122] "RemoveContainer" containerID="e0679a21bd22fba252d419c6e2fcb493d9456a77fc9e2c048a361c9f9deb36f4"
Oct 30 20:15:17.164366 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:15:17.164338    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs_odh-ai-gateway-infra(ba5d2a73-346a-4a9f-bf78-f6ddab367184)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184"
Oct 30 20:15:17.482763 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:17.482290    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused" start-of-body=
Oct 30 20:15:17.482763 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:17.482355    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused"
Oct 30 20:15:17.603336 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:17.603301    6015 scope.go:122] "RemoveContainer" containerID="b34d49f6ecbaed1d74e119f105f1707f44c65569373b57d636f180921d68be4c"
Oct 30 20:15:18.199831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.198410    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b" event={"ID":"3b000358-231f-4cd4-ac45-6bba9fada34b","Type":"ContainerStarted","Data":"f3de70dff4dd5b5c6aaab9197fc057f21b12bacfe22556552b20440d2657e58c"}
Oct 30 20:15:18.201909 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.201878    6015 generic.go:356] "Generic (PLEG): container finished" podID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerID="4efa23e013ff31557fef52bfed27798eb5b40966b24cd6b02469844238c866fa" exitCode=60
Oct 30 20:15:18.202059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.201971    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t" event={"ID":"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf","Type":"ContainerDied","Data":"4efa23e013ff31557fef52bfed27798eb5b40966b24cd6b02469844238c866fa"}
Oct 30 20:15:18.202059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.202040    6015 scope.go:122] "RemoveContainer" containerID="3f8fe391e50afd00c22cb315d3f9d42ee3c24a65feb84c09b7425b40409ee7d1"
Oct 30 20:15:18.202498 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.202477    6015 scope.go:122] "RemoveContainer" containerID="4efa23e013ff31557fef52bfed27798eb5b40966b24cd6b02469844238c866fa"
Oct 30 20:15:18.203593 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:15:18.203567    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t_odh-ai-gateway-infra(58769c7e-d2c0-48a4-b79f-6ca3b76e24bf)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf"
Oct 30 20:15:18.290844 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.288478    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"]
Oct 30 20:15:18.404282 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.404063    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"]
Oct 30 20:15:18.504843 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.504261    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused" start-of-body=
Oct 30 20:15:18.504843 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.504325    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused"
Oct 30 20:15:18.652883 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.652852    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"
Oct 30 20:15:18.764601 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.764508    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba5d2a73-346a-4a9f-bf78-f6ddab367184-kube-api-access-lj8wb\" (UniqueName: \"kubernetes.io/projected/ba5d2a73-346a-4a9f-bf78-f6ddab367184-kube-api-access-lj8wb\") pod \"ba5d2a73-346a-4a9f-bf78-f6ddab367184\" (UID: \"ba5d2a73-346a-4a9f-bf78-f6ddab367184\") "
Oct 30 20:15:18.764601 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.764570    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba5d2a73-346a-4a9f-bf78-f6ddab367184-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba5d2a73-346a-4a9f-bf78-f6ddab367184-maas-api-service-ca\") pod \"ba5d2a73-346a-4a9f-bf78-f6ddab367184\" (UID: \"ba5d2a73-346a-4a9f-bf78-f6ddab367184\") "
Oct 30 20:15:18.765033 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.765006    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba5d2a73-346a-4a9f-bf78-f6ddab367184-maas-api-service-ca" pod "ba5d2a73-346a-4a9f-bf78-f6ddab367184" (UID: "ba5d2a73-346a-4a9f-bf78-f6ddab367184"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:15:18.786836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.784454    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba5d2a73-346a-4a9f-bf78-f6ddab367184-kube-api-access-lj8wb" pod "ba5d2a73-346a-4a9f-bf78-f6ddab367184" (UID: "ba5d2a73-346a-4a9f-bf78-f6ddab367184"). InnerVolumeSpecName "kube-api-access-lj8wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:15:18.902922 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.902886    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj8wb\" (UniqueName: \"kubernetes.io/projected/ba5d2a73-346a-4a9f-bf78-f6ddab367184-kube-api-access-lj8wb\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:15:18.902922 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:18.902924    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba5d2a73-346a-4a9f-bf78-f6ddab367184-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:15:19.216830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.213917    6015 generic.go:356] "Generic (PLEG): container finished" podID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerID="f3de70dff4dd5b5c6aaab9197fc057f21b12bacfe22556552b20440d2657e58c" exitCode=60
Oct 30 20:15:19.216830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.214018    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b" event={"ID":"3b000358-231f-4cd4-ac45-6bba9fada34b","Type":"ContainerDied","Data":"f3de70dff4dd5b5c6aaab9197fc057f21b12bacfe22556552b20440d2657e58c"}
Oct 30 20:15:19.216830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.214065    6015 scope.go:122] "RemoveContainer" containerID="b34d49f6ecbaed1d74e119f105f1707f44c65569373b57d636f180921d68be4c"
Oct 30 20:15:19.216830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.214437    6015 scope.go:122] "RemoveContainer" containerID="f3de70dff4dd5b5c6aaab9197fc057f21b12bacfe22556552b20440d2657e58c"
Oct 30 20:15:19.216830 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:15:19.214722    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b_odh-ai-gateway-infra(3b000358-231f-4cd4-ac45-6bba9fada34b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b"
Oct 30 20:15:19.219711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.219215    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs" event={"ID":"ba5d2a73-346a-4a9f-bf78-f6ddab367184","Type":"ContainerDied","Data":"e4601f8712e03e357419e12fdd537343d9db5af398e5704b395c9022252bbdfb"}
Oct 30 20:15:19.219711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.219251    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"
Oct 30 20:15:19.230993 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.230966    6015 scope.go:122] "RemoveContainer" containerID="e0679a21bd22fba252d419c6e2fcb493d9456a77fc9e2c048a361c9f9deb36f4"
Oct 30 20:15:19.336460 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.336030    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"]
Oct 30 20:15:19.459022 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.458997    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"
Oct 30 20:15:19.504068 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.503974    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused" start-of-body=
Oct 30 20:15:19.504221 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.504059    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused"
Oct 30 20:15:19.621839 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.612013    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-maas-api-service-ca\") pod \"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf\" (UID: \"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf\") "
Oct 30 20:15:19.621839 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.612203    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-kube-api-access-h7xdg\" (UniqueName: \"kubernetes.io/projected/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-kube-api-access-h7xdg\") pod \"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf\" (UID: \"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf\") "
Oct 30 20:15:19.621839 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.612926    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-maas-api-service-ca" pod "58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" (UID: "58769c7e-d2c0-48a4-b79f-6ca3b76e24bf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:15:19.621839 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.614477    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:15:19.625212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.625107    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-kube-api-access-h7xdg" pod "58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" (UID: "58769c7e-d2c0-48a4-b79f-6ca3b76e24bf"). InnerVolumeSpecName "kube-api-access-h7xdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:15:19.639340 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.639313    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"]
Oct 30 20:15:19.639491 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.639361    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-b-f53eb9-29889855-h6vhs"]
Oct 30 20:15:19.720858 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:19.715664    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7xdg\" (UniqueName: \"kubernetes.io/projected/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf-kube-api-access-h7xdg\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:15:20.230461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.230435    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"
Oct 30 20:15:20.230599 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.230488    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t" event={"ID":"58769c7e-d2c0-48a4-b79f-6ca3b76e24bf","Type":"ContainerDied","Data":"4b1fc99b3063352bf15d768d70b2a78cd63da98101dcc371f787cf98b2593951"}
Oct 30 20:15:20.230599 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.230554    6015 scope.go:122] "RemoveContainer" containerID="4efa23e013ff31557fef52bfed27798eb5b40966b24cd6b02469844238c866fa"
Oct 30 20:15:20.444877 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.444846    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"
Oct 30 20:15:20.456919 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.456885    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"]
Oct 30 20:15:20.461506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.461473    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889855-g962t"]
Oct 30 20:15:20.482442 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.482353    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused" start-of-body=
Oct 30 20:15:20.482625 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.482429    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused"
Oct 30 20:15:20.525478 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.525446    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b000358-231f-4cd4-ac45-6bba9fada34b-kube-api-access-qsrvd\" (UniqueName: \"kubernetes.io/projected/3b000358-231f-4cd4-ac45-6bba9fada34b-kube-api-access-qsrvd\") pod \"3b000358-231f-4cd4-ac45-6bba9fada34b\" (UID: \"3b000358-231f-4cd4-ac45-6bba9fada34b\") "
Oct 30 20:15:20.525800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.525780    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b000358-231f-4cd4-ac45-6bba9fada34b-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b000358-231f-4cd4-ac45-6bba9fada34b-maas-api-service-ca\") pod \"3b000358-231f-4cd4-ac45-6bba9fada34b\" (UID: \"3b000358-231f-4cd4-ac45-6bba9fada34b\") "
Oct 30 20:15:20.526142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.526112    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b000358-231f-4cd4-ac45-6bba9fada34b-maas-api-service-ca" pod "3b000358-231f-4cd4-ac45-6bba9fada34b" (UID: "3b000358-231f-4cd4-ac45-6bba9fada34b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:15:20.526333 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.526316    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b000358-231f-4cd4-ac45-6bba9fada34b-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:15:20.527885 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.527855    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b000358-231f-4cd4-ac45-6bba9fada34b-kube-api-access-qsrvd" pod "3b000358-231f-4cd4-ac45-6bba9fada34b" (UID: "3b000358-231f-4cd4-ac45-6bba9fada34b"). InnerVolumeSpecName "kube-api-access-qsrvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:15:20.628209 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:20.628167    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsrvd\" (UniqueName: \"kubernetes.io/projected/3b000358-231f-4cd4-ac45-6bba9fada34b-kube-api-access-qsrvd\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:15:21.242127 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.242092    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"
Oct 30 20:15:21.242127 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.242105    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b" event={"ID":"3b000358-231f-4cd4-ac45-6bba9fada34b","Type":"ContainerDied","Data":"63b8aa633b5588318b703ff055addc2dea50a8036b46cc7c9a8a30d2e3644c39"}
Oct 30 20:15:21.242726 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.242170    6015 scope.go:122] "RemoveContainer" containerID="f3de70dff4dd5b5c6aaab9197fc057f21b12bacfe22556552b20440d2657e58c"
Oct 30 20:15:21.402997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.402642    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"]
Oct 30 20:15:21.448147 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.448106    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889855-pzk7b"]
Oct 30 20:15:21.591148 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.591102    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b" path="/var/lib/kubelet/pods/3b000358-231f-4cd4-ac45-6bba9fada34b/volumes"
Oct 30 20:15:21.591984 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.591959    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" path="/var/lib/kubelet/pods/58769c7e-d2c0-48a4-b79f-6ca3b76e24bf/volumes"
Oct 30 20:15:21.592568 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.592548    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" path="/var/lib/kubelet/pods/ba5d2a73-346a-4a9f-bf78-f6ddab367184/volumes"
Oct 30 20:15:21.614387 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.614256    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:21.615213 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.615192    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:21.616613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.616592    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:15:21.756566 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:21.756530    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:22.251831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:22.251768    6015 generic.go:356] "Generic (PLEG): container finished" podID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerID="321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2" exitCode=0
Oct 30 20:15:22.252288 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:22.251857    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" event={"ID":"f5b83e30-b72d-43b2-a980-b3fcf111d8d7","Type":"ContainerDied","Data":"321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2"}
Oct 30 20:15:22.252364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:22.252354    6015 scope.go:122] "RemoveContainer" containerID="321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2"
Oct 30 20:15:22.253648 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:22.253619    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:15:22.253732 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:22.253688    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:15:22.253732 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:22.253720    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:15:23.259816 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:23.259777    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" event={"ID":"f5b83e30-b72d-43b2-a980-b3fcf111d8d7","Type":"ContainerStarted","Data":"bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27"}
Oct 30 20:15:23.640052 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:23.640015    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:15:23.640259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:23.640188    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.126:15021/healthz/ready\": dial tcp 10.134.0.126:15021: connect: connection refused" start-of-body=
Oct 30 20:15:23.640259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:23.640239    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.126:15021/healthz/ready\": dial tcp 10.134.0.126:15021: connect: connection refused"
Oct 30 20:15:24.640135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:24.640103    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.126:15021/healthz/ready\": dial tcp 10.134.0.126:15021: connect: connection refused" start-of-body=
Oct 30 20:15:24.640589 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:24.640157    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.126:15021/healthz/ready\": dial tcp 10.134.0.126:15021: connect: connection refused"
Oct 30 20:15:25.640864 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:25.640829    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.126:15021/healthz/ready\": dial tcp 10.134.0.126:15021: connect: connection refused" start-of-body=
Oct 30 20:15:25.641277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:25.640890    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.126:15021/healthz/ready\": dial tcp 10.134.0.126:15021: connect: connection refused"
Oct 30 20:15:26.379014 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:26.378958    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:26.640293 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:26.640196    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.126:15021/healthz/ready\": dial tcp 10.134.0.126:15021: connect: connection refused" start-of-body=
Oct 30 20:15:26.640293 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:26.640275    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.126:15021/healthz/ready\": dial tcp 10.134.0.126:15021: connect: connection refused"
Oct 30 20:15:27.640512 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:27.640471    6015 patch_prober.go:29] interesting pod/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.126:15021/healthz/ready\": dial tcp 10.134.0.126:15021: connect: connection refused" start-of-body=
Oct 30 20:15:27.640944 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:27.640541    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.126:15021/healthz/ready\": dial tcp 10.134.0.126:15021: connect: connection refused"
Oct 30 20:15:28.221182 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:15:28.221145    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:15:28.659682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:28.659648    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:15:28.660242 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:28.659974    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:15:28.660997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:28.660977    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:15:30.950327 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:30.950289    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:35.483716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:35.483678    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:40.064506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:40.064473    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:41.870545 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:41.870510    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:42.022797 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:42.022754    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:42.280681 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:42.280568    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:43.468844 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:43.468769    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:44.335796 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:44.335567    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:44.545141 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:44.545110    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:45.047266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:45.047230    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:48.209711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:48.209665    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:48.410216 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:48.410174    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:50.420741 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:50.420704    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:50.586933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:50.586894    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:51.341145 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:51.341099    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:55.091418 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:55.091377    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:55.466619 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:55.466511    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:55.636648 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:55.636609    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:56.019209 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:56.019165    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:57.762546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:57.762510    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:57.926580 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:57.926534    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:58.113383 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:58.113337    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"]
Oct 30 20:15:58.113630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:58.113603    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh" podUID="316545b0-a292-4371-8fa0-3ef162b2d4b9" containerName="istio-proxy" containerID="cri-o://127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6" gracePeriod=30
Oct 30 20:15:58.138493 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:58.138462    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:15:58.254518 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:15:58.254473    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:15:59.843164 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:15:59.843132    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:02.774798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.774760    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"]
Oct 30 20:16:02.775464 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775418    6015 cpu_manager.go:414] "containerMap: removing container" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerName="cleanup"
Oct 30 20:16:02.775464 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775434    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerName="cleanup"
Oct 30 20:16:02.775464 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775444    6015 cpu_manager.go:414] "containerMap: removing container" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerName="cleanup"
Oct 30 20:16:02.775464 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775450    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerName="cleanup"
Oct 30 20:16:02.775464 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775469    6015 cpu_manager.go:414] "containerMap: removing container" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerName="cleanup"
Oct 30 20:16:02.775679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775475    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerName="cleanup"
Oct 30 20:16:02.775679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775484    6015 cpu_manager.go:414] "containerMap: removing container" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerName="cleanup"
Oct 30 20:16:02.775679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775488    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerName="cleanup"
Oct 30 20:16:02.775679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775499    6015 cpu_manager.go:414] "containerMap: removing container" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerName="cleanup"
Oct 30 20:16:02.775679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775504    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerName="cleanup"
Oct 30 20:16:02.775679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775515    6015 cpu_manager.go:414] "containerMap: removing container" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerName="cleanup"
Oct 30 20:16:02.775679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775519    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerName="cleanup"
Oct 30 20:16:02.775679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775525    6015 cpu_manager.go:414] "containerMap: removing container" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerName="cleanup"
Oct 30 20:16:02.775679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775532    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerName="cleanup"
Oct 30 20:16:02.775679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775568    6015 cpu_manager.go:414] "containerMap: removing container" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerName="cleanup"
Oct 30 20:16:02.775679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775575    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerName="cleanup"
Oct 30 20:16:02.776281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775689    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerName="cleanup"
Oct 30 20:16:02.776281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775702    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerName="cleanup"
Oct 30 20:16:02.776281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775711    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerName="cleanup"
Oct 30 20:16:02.776281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775723    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba5d2a73-346a-4a9f-bf78-f6ddab367184" containerName="cleanup"
Oct 30 20:16:02.776281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775731    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerName="cleanup"
Oct 30 20:16:02.776281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775741    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerName="cleanup"
Oct 30 20:16:02.776281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775753    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerName="cleanup"
Oct 30 20:16:02.776281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775761    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b000358-231f-4cd4-ac45-6bba9fada34b" containerName="cleanup"
Oct 30 20:16:02.776281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.775770    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerName="cleanup"
Oct 30 20:16:02.781152 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.781128    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.881397 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.881362    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"]
Oct 30 20:16:02.896558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.896520    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.896558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.896558    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.896784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.896584    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.896784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.896745    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.896926 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.896785    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.896926 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.896870    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlv6f\" (UniqueName: \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-kube-api-access-zlv6f\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.896926 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.896901    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.897051 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.896928    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.897096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.897067    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.998559 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.998518    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.998559 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.998559    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.998842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.998587    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.998842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.998635    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.998842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.998651    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.998842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.998681    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlv6f\" (UniqueName: \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-kube-api-access-zlv6f\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.998842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.998717    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.998842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.998748    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.999173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.998890    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.999173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.999102    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.999173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.999150    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.999346 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.999173    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.999346 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.999275    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:02.999617 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:02.999547    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:03.001387 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.001362    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:03.001599 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.001581    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:03.057301 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.057263    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:03.057456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.057369    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlv6f\" (UniqueName: \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-kube-api-access-zlv6f\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:03.096201 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.096161    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:03.318424 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.318390    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:16:03.411042 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.410936    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-credential-socket\") pod \"316545b0-a292-4371-8fa0-3ef162b2d4b9\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") "
Oct 30 20:16:03.411258 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.411057    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-data\") pod \"316545b0-a292-4371-8fa0-3ef162b2d4b9\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") "
Oct 30 20:16:03.411258 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.411167    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-token\" (UniqueName: \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-token\") pod \"316545b0-a292-4371-8fa0-3ef162b2d4b9\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") "
Oct 30 20:16:03.411258 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.411244    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-kube-api-access-d44s5\" (UniqueName: \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-kube-api-access-d44s5\") pod \"316545b0-a292-4371-8fa0-3ef162b2d4b9\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") "
Oct 30 20:16:03.411394 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.411317    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/316545b0-a292-4371-8fa0-3ef162b2d4b9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/316545b0-a292-4371-8fa0-3ef162b2d4b9-istiod-ca-cert\") pod \"316545b0-a292-4371-8fa0-3ef162b2d4b9\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") "
Oct 30 20:16:03.411394 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.411317    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-credential-socket" pod "316545b0-a292-4371-8fa0-3ef162b2d4b9" (UID: "316545b0-a292-4371-8fa0-3ef162b2d4b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:16:03.411394 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.411359    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-certs\") pod \"316545b0-a292-4371-8fa0-3ef162b2d4b9\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") "
Oct 30 20:16:03.411516 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.411408    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-podinfo\") pod \"316545b0-a292-4371-8fa0-3ef162b2d4b9\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") "
Oct 30 20:16:03.411516 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.411496    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-envoy\") pod \"316545b0-a292-4371-8fa0-3ef162b2d4b9\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") "
Oct 30 20:16:03.411592 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.411567    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-socket\") pod \"316545b0-a292-4371-8fa0-3ef162b2d4b9\" (UID: \"316545b0-a292-4371-8fa0-3ef162b2d4b9\") "
Oct 30 20:16:03.411898 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.411868    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-certs" pod "316545b0-a292-4371-8fa0-3ef162b2d4b9" (UID: "316545b0-a292-4371-8fa0-3ef162b2d4b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:16:03.412029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.411989    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-data" pod "316545b0-a292-4371-8fa0-3ef162b2d4b9" (UID: "316545b0-a292-4371-8fa0-3ef162b2d4b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:16:03.412132 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.412108    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:16:03.412195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.412138    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:16:03.412195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.412154    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:16:03.412312 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.412226    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-socket" pod "316545b0-a292-4371-8fa0-3ef162b2d4b9" (UID: "316545b0-a292-4371-8fa0-3ef162b2d4b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:16:03.412545 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.412497    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/316545b0-a292-4371-8fa0-3ef162b2d4b9-istiod-ca-cert" pod "316545b0-a292-4371-8fa0-3ef162b2d4b9" (UID: "316545b0-a292-4371-8fa0-3ef162b2d4b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:16:03.414488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.414460    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-token" pod "316545b0-a292-4371-8fa0-3ef162b2d4b9" (UID: "316545b0-a292-4371-8fa0-3ef162b2d4b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:16:03.414590 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.414564    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-kube-api-access-d44s5" pod "316545b0-a292-4371-8fa0-3ef162b2d4b9" (UID: "316545b0-a292-4371-8fa0-3ef162b2d4b9"). InnerVolumeSpecName "kube-api-access-d44s5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:16:03.414712 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.414692    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-podinfo" pod "316545b0-a292-4371-8fa0-3ef162b2d4b9" (UID: "316545b0-a292-4371-8fa0-3ef162b2d4b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:16:03.414712 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.414701    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-envoy" pod "316545b0-a292-4371-8fa0-3ef162b2d4b9" (UID: "316545b0-a292-4371-8fa0-3ef162b2d4b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:16:03.513917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.513880    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/316545b0-a292-4371-8fa0-3ef162b2d4b9-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:16:03.513917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.513918    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:16:03.514179 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.513933    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:16:03.514179 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.513948    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/316545b0-a292-4371-8fa0-3ef162b2d4b9-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:16:03.514179 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.513963    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:16:03.514179 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.513978    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d44s5\" (UniqueName: \"kubernetes.io/projected/316545b0-a292-4371-8fa0-3ef162b2d4b9-kube-api-access-d44s5\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:16:03.587551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.587519    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"]
Oct 30 20:16:03.588900 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:16:03.588676    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f9ece5_2bcf_4d5c_8b3c_9157f227c682.slice/crio-ec03abdfdbe348914a5c9f3912cedc74cf8225d400299c9b7e7b6fce73998c17 WatchSource:0}: Error finding container ec03abdfdbe348914a5c9f3912cedc74cf8225d400299c9b7e7b6fce73998c17: Status 404 returned error can't find the container with id ec03abdfdbe348914a5c9f3912cedc74cf8225d400299c9b7e7b6fce73998c17
Oct 30 20:16:03.592140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.590451    6015 generic.go:356] "Generic (PLEG): container finished" podID="316545b0-a292-4371-8fa0-3ef162b2d4b9" containerID="127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6" exitCode=0
Oct 30 20:16:03.592140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.590508    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh" event={"ID":"316545b0-a292-4371-8fa0-3ef162b2d4b9","Type":"ContainerDied","Data":"127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6"}
Oct 30 20:16:03.592140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.590543    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh" event={"ID":"316545b0-a292-4371-8fa0-3ef162b2d4b9","Type":"ContainerDied","Data":"26b4d0c0d3a0358820f557dbbee730cf19cbdd7527c1a841e0ea3e70a4770e7a"}
Oct 30 20:16:03.592140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.590563    6015 scope.go:122] "RemoveContainer" containerID="127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6"
Oct 30 20:16:03.592140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.590685    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"
Oct 30 20:16:03.592140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.591979    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:03.592140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.592043    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:03.592140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.592071    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:03.606784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.606760    6015 scope.go:122] "RemoveContainer" containerID="127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6"
Oct 30 20:16:03.607723 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:16:03.607156    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6\": container with ID starting with 127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6 not found: ID does not exist" containerID="127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6"
Oct 30 20:16:03.607723 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.607184    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6"} err="failed to get container status \"127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6\": rpc error: code = NotFound desc = could not find container \"127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6\": container with ID starting with 127abdf05ed16ca898f5f475afd9ec9c44281ed04124d91bdab16cd9a73266e6 not found: ID does not exist"
Oct 30 20:16:03.754426 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.754391    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"]
Oct 30 20:16:03.800319 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:03.800282    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-praxis-a-389c4e-openshift-default-6c8ddcd78f-gsvkh"]
Oct 30 20:16:04.601855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:04.601774    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" event={"ID":"35f9ece5-2bcf-4d5c-8b3c-9157f227c682","Type":"ContainerStarted","Data":"da567e77baaad3c7fb04e01eef240d97eb543d4bedc7c1c5d2931789dac44b9b"}
Oct 30 20:16:04.601855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:04.601859    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" event={"ID":"35f9ece5-2bcf-4d5c-8b3c-9157f227c682","Type":"ContainerStarted","Data":"ec03abdfdbe348914a5c9f3912cedc74cf8225d400299c9b7e7b6fce73998c17"}
Oct 30 20:16:04.688790 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:04.688753    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:04.721752 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:04.721692    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" podStartSLOduration=2.72167689 podStartE2EDuration="2.72167689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:04.71983412 +0000 UTC m=+3027.262641387" watchObservedRunningTime="2026-10-30 20:16:04.72167689 +0000 UTC m=+3027.264484155"
Oct 30 20:16:05.098899 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:05.098851    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:05.099453 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:05.098936    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 20:16:05.099453 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:05.098999    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 20:16:05.604285 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:05.604248    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="316545b0-a292-4371-8fa0-3ef162b2d4b9" path="/var/lib/kubelet/pods/316545b0-a292-4371-8fa0-3ef162b2d4b9/volumes"
Oct 30 20:16:06.097347 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:06.097299    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 20:16:06.097572 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:06.097370    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 20:16:06.939882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:06.939845    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:07.097146 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:07.097104    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 20:16:07.097323 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:07.097167    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 20:16:07.663721 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:07.662644    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:07.900964 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:07.900928    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:08.097555 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:08.097518    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 20:16:08.098182 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:08.097581    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 20:16:09.097405 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:09.097362    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 20:16:09.097715 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:09.097681    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 20:16:09.389177 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:09.389073    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:10.097598 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:10.097557    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 20:16:10.097834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:10.097617    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 20:16:11.097083 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:11.097040    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 20:16:11.097496 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:11.097436    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 20:16:11.534078 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:11.533909    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:11.712386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:11.712349    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:12.240832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:12.240552    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:12.244527 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:12.241321    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:12.245657 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:12.245635    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:16:12.361825 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:12.361188    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:16:12.361825 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:12.361320    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:16:12.998432 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:12.998385    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:13.184472 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:13.184432    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:14.540980 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:14.540947    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:16.574504 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:16.574456    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:16.762534 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:16.762505    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:19.346970 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:19.346934    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:23.903479 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:23.903446    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:28.217372 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:16:28.217326    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:16:28.519298 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:28.519205    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:28.688100 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:28.688065    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:28.849006 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:28.848968    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:32.682654 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:32.682615    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:34.226832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:34.225906    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:34.392829 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:34.392540    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:34.559344 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:34.559309    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:35.071468 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:35.071433    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:36.518181 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:36.518147    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:36.774395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:36.774291    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:37.091785 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.091747    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"]
Oct 30 20:16:37.092618 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.092599    6015 cpu_manager.go:414] "containerMap: removing container" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerName="cleanup"
Oct 30 20:16:37.092722 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.092619    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58769c7e-d2c0-48a4-b79f-6ca3b76e24bf" containerName="cleanup"
Oct 30 20:16:37.092722 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.092703    6015 cpu_manager.go:414] "containerMap: removing container" podUID="316545b0-a292-4371-8fa0-3ef162b2d4b9" containerName="istio-proxy"
Oct 30 20:16:37.092722 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.092708    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="316545b0-a292-4371-8fa0-3ef162b2d4b9" containerName="istio-proxy"
Oct 30 20:16:37.092994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.092966    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="316545b0-a292-4371-8fa0-3ef162b2d4b9" containerName="istio-proxy"
Oct 30 20:16:37.097155 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.097125    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.140646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.140611    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"]
Oct 30 20:16:37.195257 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.195210    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-487c5f-openshift-default-dockercfg-4xx95\""
Oct 30 20:16:37.196729 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.196698    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-token\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.196915 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.196747    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-data\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.196915 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.196884    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-socket\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.197044 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.196936    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-podinfo\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.197102 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.197067    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41109844-dc57-4bb7-a1db-719717d9cbb9-istiod-ca-cert\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.197159 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.197146    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-credential-socket\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.197223 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.197176    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-envoy\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.197279 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.197249    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbzlb\" (UniqueName: \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-kube-api-access-rbzlb\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.197279 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.197272    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-certs\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.202060 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.202020    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:37.299828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.298766    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41109844-dc57-4bb7-a1db-719717d9cbb9-istiod-ca-cert\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.299828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.298887    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-credential-socket\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.299828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.298925    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-envoy\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.299828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.298991    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbzlb\" (UniqueName: \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-kube-api-access-rbzlb\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.299828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.299028    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-certs\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.299828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.299067    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-token\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.299828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.299095    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-data\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.299828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.299127    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-socket\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.299828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.299197    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-podinfo\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.300951 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.300862    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41109844-dc57-4bb7-a1db-719717d9cbb9-istiod-ca-cert\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.301208 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.301182    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-credential-socket\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.301612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.301583    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-data\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.301763 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.301744    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-certs\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.301909 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.301889    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-socket\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.304650 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.304618    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-podinfo\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.305355 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.305334    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-envoy\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.358612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.358542    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbzlb\" (UniqueName: \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-kube-api-access-rbzlb\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.359013 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.358989    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-token\") pod \"e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") " pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.414684 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.414645    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:37.415462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.415433    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"]
Oct 30 20:16:37.419997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.419972    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.491400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.491376    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w1-cafbb2-openshift-default-dockercfg-hwnb9\""
Oct 30 20:16:37.495883 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.495853    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"]
Oct 30 20:16:37.513615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.511173    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-socket\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.513615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.511243    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs2ft\" (UniqueName: \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-kube-api-access-zs2ft\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.513615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.511379    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-envoy\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.513615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.511447    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-istio-token\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.513615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.511480    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b24513-c127-49cf-a507-735fe4e47192-istio-podinfo\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.513615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.511594    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-credential-socket\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.513615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.511624    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-data\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.513615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.511675    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b24513-c127-49cf-a507-735fe4e47192-istiod-ca-cert\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.513615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.511699    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-certs\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.519897 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.518488    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.625582    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-data\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.625656    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b24513-c127-49cf-a507-735fe4e47192-istiod-ca-cert\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.625681    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-certs\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.625725    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-socket\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.625769    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs2ft\" (UniqueName: \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-kube-api-access-zs2ft\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.625911    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-envoy\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.625972    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-istio-token\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.626003    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b24513-c127-49cf-a507-735fe4e47192-istio-podinfo\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.626087    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-credential-socket\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.626625    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-credential-socket\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.626909    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-data\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.627538    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b24513-c127-49cf-a507-735fe4e47192-istiod-ca-cert\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.627969    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-certs\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.628232    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-socket\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.636881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.634618    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b24513-c127-49cf-a507-735fe4e47192-istio-podinfo\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.658857 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.656277    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-envoy\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.687323 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.687285    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs2ft\" (UniqueName: \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-kube-api-access-zs2ft\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.689338 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.689305    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-istio-token\") pod \"e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") " pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.689700 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.689670    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:37.797997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.797955    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w1-cafbb2-openshift-default-dockercfg-hwnb9\""
Oct 30 20:16:37.799936 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.799899    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:37.846593 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.846556    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:37.855704 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.855305    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"]
Oct 30 20:16:37.866342 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:16:37.866305    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41109844_dc57_4bb7_a1db_719717d9cbb9.slice/crio-8bd178285a448ea75b9154bb61ea8e10e1b792ab98ba5db7060c3cb164f2c10b WatchSource:0}: Error finding container 8bd178285a448ea75b9154bb61ea8e10e1b792ab98ba5db7060c3cb164f2c10b: Status 404 returned error can't find the container with id 8bd178285a448ea75b9154bb61ea8e10e1b792ab98ba5db7060c3cb164f2c10b
Oct 30 20:16:37.871697 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.871648    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:37.871855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.871756    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:37.871855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:37.871819    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:38.028987 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:38.028947    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" event={"ID":"41109844-dc57-4bb7-a1db-719717d9cbb9","Type":"ContainerStarted","Data":"1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7"}
Oct 30 20:16:38.029158 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:38.029013    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" event={"ID":"41109844-dc57-4bb7-a1db-719717d9cbb9","Type":"ContainerStarted","Data":"8bd178285a448ea75b9154bb61ea8e10e1b792ab98ba5db7060c3cb164f2c10b"}
Oct 30 20:16:38.147955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:38.147847    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" podStartSLOduration=1.147790946 podStartE2EDuration="1.147790946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:38.145451512 +0000 UTC m=+3060.688258801" watchObservedRunningTime="2026-10-30 20:16:38.147790946 +0000 UTC m=+3060.690598210"
Oct 30 20:16:38.181646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:38.181601    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"]
Oct 30 20:16:38.187655 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:16:38.187611    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b24513_c127_49cf_a507_735fe4e47192.slice/crio-1a1344775c2777f93c201d7c2872c0e4da13d2731c6bfbe090ea0e6849884798 WatchSource:0}: Error finding container 1a1344775c2777f93c201d7c2872c0e4da13d2731c6bfbe090ea0e6849884798: Status 404 returned error can't find the container with id 1a1344775c2777f93c201d7c2872c0e4da13d2731c6bfbe090ea0e6849884798
Oct 30 20:16:38.190597 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:38.190561    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:38.190693 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:38.190643    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:38.190693 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:38.190676    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:38.415397 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:38.415303    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:38.421320 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:38.421290    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:39.037256 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:39.037171    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" event={"ID":"05b24513-c127-49cf-a507-735fe4e47192","Type":"ContainerStarted","Data":"ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7"}
Oct 30 20:16:39.037636 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:39.037282    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" event={"ID":"05b24513-c127-49cf-a507-735fe4e47192","Type":"ContainerStarted","Data":"1a1344775c2777f93c201d7c2872c0e4da13d2731c6bfbe090ea0e6849884798"}
Oct 30 20:16:39.037636 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:39.037538    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:39.038685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:39.038663    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:16:39.155111 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:39.155061    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" podStartSLOduration=2.155045915 podStartE2EDuration="2.155045915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:39.153392486 +0000 UTC m=+3061.696199751" watchObservedRunningTime="2026-10-30 20:16:39.155045915 +0000 UTC m=+3061.697853233"
Oct 30 20:16:39.669204 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:39.669163    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:39.801016 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:39.800972    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:39.807583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:39.807556    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:40.043054 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:40.043023    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:40.044073 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:40.044053    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:16:41.021250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:41.021207    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:41.231933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:41.231899    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:41.668210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:41.668156    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:42.022442 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:42.022345    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:42.238146 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:42.238114    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:42.399836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:42.399770    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:43.360934 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:43.360893    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:43.961160 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:43.961127    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:44.141825 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:44.141773    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:44.326582 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:44.326546    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:44.503259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:44.503225    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:45.032289 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:45.032224    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:48.022130 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.022032    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:48.102550 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.102516    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"]
Oct 30 20:16:48.108095 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.108073    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.170366 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.170318    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.170561 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.170394    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.170561 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.170499    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.170561 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.170543    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b47r\" (UniqueName: \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-kube-api-access-6b47r\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.170682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.170622    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.170682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.170664    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.170876 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.170855    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.171019 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.171003    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.171061 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.171039    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.207928 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.207890    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"]
Oct 30 20:16:48.243192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.243146    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:48.272755 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.272676    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.272755 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.272725    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.272755 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.272750    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b47r\" (UniqueName: \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-kube-api-access-6b47r\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.273135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.272785    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.273135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.272851    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.273135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.272951    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.273135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.273076    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.273135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.273113    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.273408 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.273180    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.273408 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.273396    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.273528 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.273498    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.273705 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.273674    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.273905 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.273882    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.273993 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.273926    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.275772 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.275751    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.275937 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.275918    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.335856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.335793    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b47r\" (UniqueName: \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-kube-api-access-6b47r\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.338286 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.338264    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.423380 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.423335    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:48.508413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.508367    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:48.854838 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.854790    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"]
Oct 30 20:16:48.860316 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:16:48.860275    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754fe397_b5f4_41d7_86d3_97215c2ff9e9.slice/crio-6f71a9820f22b233962b6dc38829f5c37586f61bf39b82cbe587e94e73415a56 WatchSource:0}: Error finding container 6f71a9820f22b233962b6dc38829f5c37586f61bf39b82cbe587e94e73415a56: Status 404 returned error can't find the container with id 6f71a9820f22b233962b6dc38829f5c37586f61bf39b82cbe587e94e73415a56
Oct 30 20:16:48.862780 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.862750    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:48.862893 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.862854    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:48.862930 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:48.862894    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:16:49.109961 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:49.109868    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" event={"ID":"754fe397-b5f4-41d7-86d3-97215c2ff9e9","Type":"ContainerStarted","Data":"f56b0f5edf06e2d9b05150bf26fd0a4ca3c8204898a7d68cad3678ddb90f1795"}
Oct 30 20:16:49.109961 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:49.109950    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" event={"ID":"754fe397-b5f4-41d7-86d3-97215c2ff9e9","Type":"ContainerStarted","Data":"6f71a9820f22b233962b6dc38829f5c37586f61bf39b82cbe587e94e73415a56"}
Oct 30 20:16:49.224959 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:49.224906    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" podStartSLOduration=1.22489129 podStartE2EDuration="1.22489129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:49.223860578 +0000 UTC m=+3071.766667844" watchObservedRunningTime="2026-10-30 20:16:49.22489129 +0000 UTC m=+3071.767698554"
Oct 30 20:16:49.421478 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:49.421388    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:49.423511 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:49.423485    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:49.425007 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:49.424982    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused" start-of-body=
Oct 30 20:16:49.425111 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:49.425028    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused"
Oct 30 20:16:49.622651 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:49.622612    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:50.282931 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:50.282835    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:50.423855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:50.423790    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused" start-of-body=
Oct 30 20:16:50.424065 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:50.423867    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused"
Oct 30 20:16:51.424267 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:51.424221    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused" start-of-body=
Oct 30 20:16:51.424678 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:51.424283    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused"
Oct 30 20:16:52.211496 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.211456    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:52.420204 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.420155    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:52.424146 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.424112    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused" start-of-body=
Oct 30 20:16:52.424326 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.424177    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused"
Oct 30 20:16:52.602872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.602153    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"]
Oct 30 20:16:52.607395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.607360    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:16:52.635151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.635113    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"]
Oct 30 20:16:52.651070 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.650859    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt\" (UID: \"18a49027-c3a6-44b7-b1af-f0f19c6cf06e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:16:52.651070 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.650999    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b75g\" (UniqueName: \"kubernetes.io/projected/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-kube-api-access-8b75g\") pod \"payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt\" (UID: \"18a49027-c3a6-44b7-b1af-f0f19c6cf06e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:16:52.687212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.687177    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-056a27-dockercfg-shfgb\""
Oct 30 20:16:52.687549 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.687530    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-056a27\""
Oct 30 20:16:52.734515 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.732395    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"]
Oct 30 20:16:52.771657 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.771565    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt\" (UID: \"18a49027-c3a6-44b7-b1af-f0f19c6cf06e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:16:52.771938 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.771676    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b75g\" (UniqueName: \"kubernetes.io/projected/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-kube-api-access-8b75g\") pod \"payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt\" (UID: \"18a49027-c3a6-44b7-b1af-f0f19c6cf06e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:16:52.776829 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.773157    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt\" (UID: \"18a49027-c3a6-44b7-b1af-f0f19c6cf06e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:16:52.824113 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.824081    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"]
Oct 30 20:16:52.824354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.824183    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:16:52.834078 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.831742    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b75g\" (UniqueName: \"kubernetes.io/projected/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-kube-api-access-8b75g\") pod \"payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt\" (UID: \"18a49027-c3a6-44b7-b1af-f0f19c6cf06e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:16:52.925494 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:52.925402    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:16:53.000070 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:53.000015    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cd6888d-2f0c-4594-997c-0ca022e1491f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn\" (UID: \"8cd6888d-2f0c-4594-997c-0ca022e1491f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:16:53.000296 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:53.000076    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sw4p\" (UniqueName: \"kubernetes.io/projected/8cd6888d-2f0c-4594-997c-0ca022e1491f-kube-api-access-8sw4p\") pod \"payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn\" (UID: \"8cd6888d-2f0c-4594-997c-0ca022e1491f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:16:53.105605 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:53.104953    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cd6888d-2f0c-4594-997c-0ca022e1491f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn\" (UID: \"8cd6888d-2f0c-4594-997c-0ca022e1491f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:16:53.105605 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:53.105008    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sw4p\" (UniqueName: \"kubernetes.io/projected/8cd6888d-2f0c-4594-997c-0ca022e1491f-kube-api-access-8sw4p\") pod \"payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn\" (UID: \"8cd6888d-2f0c-4594-997c-0ca022e1491f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:16:53.106086 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:53.106054    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cd6888d-2f0c-4594-997c-0ca022e1491f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn\" (UID: \"8cd6888d-2f0c-4594-997c-0ca022e1491f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:16:53.163791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:53.163760    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sw4p\" (UniqueName: \"kubernetes.io/projected/8cd6888d-2f0c-4594-997c-0ca022e1491f-kube-api-access-8sw4p\") pod \"payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn\" (UID: \"8cd6888d-2f0c-4594-997c-0ca022e1491f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:16:53.338515 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:53.338476    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"]
Oct 30 20:16:53.344586 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:16:53.344558    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a49027_c3a6_44b7_b1af_f0f19c6cf06e.slice/crio-2a7f569032fbca06697305f023b1019666687a88b1f6ea191051d6b0f7cb21f4 WatchSource:0}: Error finding container 2a7f569032fbca06697305f023b1019666687a88b1f6ea191051d6b0f7cb21f4: Status 404 returned error can't find the container with id 2a7f569032fbca06697305f023b1019666687a88b1f6ea191051d6b0f7cb21f4
Oct 30 20:16:53.424220 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:53.424182    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused" start-of-body=
Oct 30 20:16:53.424508 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:53.424477    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused"
Oct 30 20:16:53.458089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:53.458044    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:16:53.903992 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:53.903317    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"]
Oct 30 20:16:54.149080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:54.149044    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt" event={"ID":"18a49027-c3a6-44b7-b1af-f0f19c6cf06e","Type":"ContainerStarted","Data":"697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f"}
Oct 30 20:16:54.149262 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:54.149099    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt" event={"ID":"18a49027-c3a6-44b7-b1af-f0f19c6cf06e","Type":"ContainerStarted","Data":"2a7f569032fbca06697305f023b1019666687a88b1f6ea191051d6b0f7cb21f4"}
Oct 30 20:16:54.149945 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:54.149929    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:16:54.151405 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:54.151381    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn" event={"ID":"8cd6888d-2f0c-4594-997c-0ca022e1491f","Type":"ContainerStarted","Data":"872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf"}
Oct 30 20:16:54.151518 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:54.151426    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn" event={"ID":"8cd6888d-2f0c-4594-997c-0ca022e1491f","Type":"ContainerStarted","Data":"a9f47bb7f64fe4edae74dd78d2891a7b97b3bad8ec894bb56d95ab855308be85"}
Oct 30 20:16:54.151518 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:54.151477    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:16:54.262194 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:54.262092    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt" podStartSLOduration=2.262075553 podStartE2EDuration="2.262075553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:54.2596328 +0000 UTC m=+3076.802440067" watchObservedRunningTime="2026-10-30 20:16:54.262075553 +0000 UTC m=+3076.804882835"
Oct 30 20:16:54.385835 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:54.378645    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn" podStartSLOduration=2.3786234 podStartE2EDuration="2.3786234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:16:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:16:54.377572437 +0000 UTC m=+3076.920379702" watchObservedRunningTime="2026-10-30 20:16:54.3786234 +0000 UTC m=+3076.921430668"
Oct 30 20:16:54.424515 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:54.424470    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused" start-of-body=
Oct 30 20:16:54.424941 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:54.424549    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused"
Oct 30 20:16:54.928350 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:54.928316    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:55.136243 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:55.136210    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:55.292731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:55.292489    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:55.424488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:55.424445    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused" start-of-body=
Oct 30 20:16:55.424679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:55.424520    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.135:15021/healthz/ready\": dial tcp 10.134.0.135:15021: connect: connection refused"
Oct 30 20:16:56.359114 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:56.359073    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:16:56.428497 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:56.428468    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:56.429060 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:56.429043    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:56.429880 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:56.429862    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:16:58.254694 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:16:58.254648    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:16:59.921247 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:16:59.921209    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:04.579317 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:04.579267    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:05.160998 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:05.160966    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:17:06.168476 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:06.168439    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:17:09.139270 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:09.139236    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:13.713673 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:13.713632    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:18.388127 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.388094    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"]
Oct 30 20:17:18.392665 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.392642    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.426433 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.426397    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:18.457888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.457068    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.457888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.457134    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.457888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.457198    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.457888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.457246    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.457888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.457331    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.457888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.457360    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.457888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.457572    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgkqz\" (UniqueName: \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-kube-api-access-lgkqz\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.457888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.457677    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.457888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.457734    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.493080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.493044    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"]
Oct 30 20:17:18.559316 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559283    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.559509 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559344    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.559509 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559404    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.559509 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559439    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.559509 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559494    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.559745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559523    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.559745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559589    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.559745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559621    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.559745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559678    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgkqz\" (UniqueName: \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-kube-api-access-lgkqz\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.559993 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559763    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-certs\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.559993 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559837    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-data\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.559993 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.559927    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.560108 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.560086    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-credential-socket\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.560196 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.560163    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istiod-ca-cert\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.562084 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.562062    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-envoy\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.562494 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.562471    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-podinfo\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.618562 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.618530    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-token\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.618759 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.618738    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgkqz\" (UniqueName: \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-kube-api-access-lgkqz\") pod \"e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") " pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:18.709344 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:18.709245    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:19.145526 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:19.145492    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"]
Oct 30 20:17:19.151977 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:17:19.151946    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c63c98d_bb30_4e3d_a80e_f509c851dabc.slice/crio-bb625a19a1a950b4ae7eca2170c521a6083c4b5fd330e1646a769893d9ea37de WatchSource:0}: Error finding container bb625a19a1a950b4ae7eca2170c521a6083c4b5fd330e1646a769893d9ea37de: Status 404 returned error can't find the container with id bb625a19a1a950b4ae7eca2170c521a6083c4b5fd330e1646a769893d9ea37de
Oct 30 20:17:19.154551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:19.154515    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:17:19.154631 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:19.154592    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:17:19.154631 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:19.154625    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:17:19.374461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:19.374422    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" event={"ID":"1c63c98d-bb30-4e3d-a80e-f509c851dabc","Type":"ContainerStarted","Data":"7073b395103fef86215593fae12f46e7e86bfade8378f8b90d6d7eda8f8ffcd5"}
Oct 30 20:17:19.374665 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:19.374487    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" event={"ID":"1c63c98d-bb30-4e3d-a80e-f509c851dabc","Type":"ContainerStarted","Data":"bb625a19a1a950b4ae7eca2170c521a6083c4b5fd330e1646a769893d9ea37de"}
Oct 30 20:17:19.489797 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:19.489671    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" podStartSLOduration=1.489650259 podStartE2EDuration="1.489650259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:17:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:17:19.488963461 +0000 UTC m=+3102.031770735" watchObservedRunningTime="2026-10-30 20:17:19.489650259 +0000 UTC m=+3102.032457533"
Oct 30 20:17:19.716832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:19.712441    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:19.919084 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:19.919047    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:20.711454 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:20.711414    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused" start-of-body=
Oct 30 20:17:20.711891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:20.711491    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" podUID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused"
Oct 30 20:17:21.710446 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:21.710401    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused" start-of-body=
Oct 30 20:17:21.710624 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:21.710475    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" podUID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused"
Oct 30 20:17:22.709727 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:22.709688    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused" start-of-body=
Oct 30 20:17:22.710188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:22.709750    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" podUID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused"
Oct 30 20:17:23.500089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:23.500049    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:23.712791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:23.712754    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused" start-of-body=
Oct 30 20:17:23.713422 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:23.713390    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" podUID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused"
Oct 30 20:17:23.720123 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:23.720088    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:23.881085 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:23.881046    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:24.710729 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:24.710688    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused" start-of-body=
Oct 30 20:17:24.710985 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:24.710753    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" podUID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused"
Oct 30 20:17:25.711534 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:25.711498    6015 patch_prober.go:29] interesting pod/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused" start-of-body=
Oct 30 20:17:25.712229 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:25.712179    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" podUID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.138:15021/healthz/ready\": dial tcp 10.134.0.138:15021: connect: connection refused"
Oct 30 20:17:26.714740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:26.714705    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:26.715224 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:26.715201    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:26.716025 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:26.716002    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:17:28.218027 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:17:28.217992    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:17:28.825888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:28.825852    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:33.503115 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:33.503075    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:33.704789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:33.704743    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:33.860944 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:33.860900    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:36.648565 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:36.648525    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:36.802474 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:36.802432    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:38.251054 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:38.251012    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:41.605060 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:41.605027    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:41.811879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:41.811798    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:42.698879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:42.698838    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:42.911416 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:42.911375    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:43.069764 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:43.069726    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:47.515448 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:47.515389    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:52.152059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:52.151989    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:55.080037 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:55.079988    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.133:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:17:55.080643 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:55.080087    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.133:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:17:56.092281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:56.091925    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.134:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:17:56.092281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:56.092009    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.134:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:17:56.171084 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:56.170992    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:57.989525 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:57.981406    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:58.218888 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:17:58.218853    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:17:58.220596 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.220569    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:58.707046 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.707008    6015 generic.go:356] "Generic (PLEG): container finished" podID="05b24513-c127-49cf-a507-735fe4e47192" containerID="ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7" exitCode=0
Oct 30 20:17:58.707250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.707085    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" event={"ID":"05b24513-c127-49cf-a507-735fe4e47192","Type":"ContainerDied","Data":"ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7"}
Oct 30 20:17:58.707606 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.707588    6015 scope.go:122] "RemoveContainer" containerID="ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7"
Oct 30 20:17:58.709193 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.709168    6015 generic.go:356] "Generic (PLEG): container finished" podID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerID="1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7" exitCode=0
Oct 30 20:17:58.709327 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.709254    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" event={"ID":"41109844-dc57-4bb7-a1db-719717d9cbb9","Type":"ContainerDied","Data":"1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7"}
Oct 30 20:17:58.709542 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.709515    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:17:58.709629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.709581    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:17:58.709629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.709612    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:17:58.709741 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.709722    6015 scope.go:122] "RemoveContainer" containerID="1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7"
Oct 30 20:17:58.711422 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.711384    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:58.711535 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.711446    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:17:58.711535 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.711515    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:17:58.711663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.711560    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:17:58.870393 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:58.870346    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:59.202880 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:59.202157    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:17:59.727830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:59.725144    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" event={"ID":"05b24513-c127-49cf-a507-735fe4e47192","Type":"ContainerStarted","Data":"32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35"}
Oct 30 20:17:59.728878 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:59.728685    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" event={"ID":"41109844-dc57-4bb7-a1db-719717d9cbb9","Type":"ContainerStarted","Data":"965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4"}
Oct 30 20:17:59.807833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:59.806349    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:17:59.807833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:59.806516    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused" start-of-body=
Oct 30 20:17:59.807833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:17:59.806643    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused"
Oct 30 20:18:00.416831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.416221    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:18:00.416831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.416392    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused" start-of-body=
Oct 30 20:18:00.416831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.416437    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused"
Oct 30 20:18:00.446184 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.446138    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"]
Oct 30 20:18:00.449704 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.449682    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.451014 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.450975    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:00.483830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.482931    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-socket\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.483830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.483040    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88448a71-1695-4c8e-9eea-7acf648d9f0f-istiod-ca-cert\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.483830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.483141    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-token\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.483830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.483186    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-podinfo\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.483830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.483260    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-data\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.483830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.483346    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-envoy\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.483830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.483390    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57xkz\" (UniqueName: \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-kube-api-access-57xkz\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.483830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.483477    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-credential-socket\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.483830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.483580    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-certs\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.512834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.508608    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w0-e4864d-openshift-default-dockercfg-q2ktw\""
Oct 30 20:18:00.534716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.534662    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"]
Oct 30 20:18:00.600872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.600838    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-socket\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.601197 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.601170    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88448a71-1695-4c8e-9eea-7acf648d9f0f-istiod-ca-cert\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.601392 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.601372    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-token\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.601530 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.601514    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-podinfo\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.601675 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.601659    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-data\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.601873 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.601853    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-envoy\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.602011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.601994    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57xkz\" (UniqueName: \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-kube-api-access-57xkz\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.602175 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.602158    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-credential-socket\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.602375 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.602355    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-certs\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.603068 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.603046    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-certs\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.603479 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.603458    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-socket\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.608298 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.604254    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88448a71-1695-4c8e-9eea-7acf648d9f0f-istiod-ca-cert\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.639836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.632561    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:00.639836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.633027    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-data\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.639836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.633597    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-credential-socket\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.670326 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.656140    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-envoy\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.730214 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.730150    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57xkz\" (UniqueName: \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-kube-api-access-57xkz\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.730433 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.730369    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-token\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.730552 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.730525    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-podinfo\") pod \"e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") " pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.789834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.775918    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:00.813890 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.803038    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused" start-of-body=
Oct 30 20:18:00.813890 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.803111    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused"
Oct 30 20:18:00.830828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:00.827330    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:01.316867 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.315270    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"]
Oct 30 20:18:01.324152 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.324108    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:18:01.324398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.324373    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:18:01.324569 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.324548    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:18:01.424925 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.419267    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused" start-of-body=
Oct 30 20:18:01.424925 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.419330    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused"
Oct 30 20:18:01.748148 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.747501    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" event={"ID":"88448a71-1695-4c8e-9eea-7acf648d9f0f","Type":"ContainerStarted","Data":"e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02"}
Oct 30 20:18:01.748148 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.747556    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" event={"ID":"88448a71-1695-4c8e-9eea-7acf648d9f0f","Type":"ContainerStarted","Data":"320c81b3850be6036a52a6904d4d3d977a141f1e997b42134d167ffdad36c305"}
Oct 30 20:18:01.798837 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.778961    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:01.820833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.806436    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused" start-of-body=
Oct 30 20:18:01.820833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.806507    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused"
Oct 30 20:18:01.874833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:01.874312    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" podStartSLOduration=1.874291302 podStartE2EDuration="1.874291302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:01.873919207 +0000 UTC m=+3144.416726471" watchObservedRunningTime="2026-10-30 20:18:01.874291302 +0000 UTC m=+3144.417098568"
Oct 30 20:18:02.415834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:02.415237    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused" start-of-body=
Oct 30 20:18:02.415834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:02.415305    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused"
Oct 30 20:18:02.811833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:02.806222    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:02.811833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:02.806901    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused" start-of-body=
Oct 30 20:18:02.811833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:02.806955    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused"
Oct 30 20:18:02.952883 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:02.952852    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:03.415314 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:03.415268    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused" start-of-body=
Oct 30 20:18:03.415647 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:03.415614    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused"
Oct 30 20:18:03.763015 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:03.762933    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:03.763956 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:03.763936    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:18:03.812829 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:03.804209    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused" start-of-body=
Oct 30 20:18:03.812829 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:03.804275    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused"
Oct 30 20:18:04.423834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:04.415273    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused" start-of-body=
Oct 30 20:18:04.423834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:04.415342    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.133:15021/healthz/ready\": dial tcp 10.134.0.133:15021: connect: connection refused"
Oct 30 20:18:04.674894 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:04.674469    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:04.804831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:04.804227    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused" start-of-body=
Oct 30 20:18:04.804831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:04.804294    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.134:15021/healthz/ready\": dial tcp 10.134.0.134:15021: connect: connection refused"
Oct 30 20:18:04.864577 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:04.864496    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:05.043376 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:05.043227    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:05.419488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:05.419402    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:18:05.419826 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:05.419791    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:18:05.420798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:05.420778    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:18:05.795043 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:05.795000    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:05.805181 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:05.805154    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:18:05.805620 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:05.805605    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:18:05.806354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:05.806333    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:18:05.959535 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:05.959494    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:06.016691 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:06.016641    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"]
Oct 30 20:18:06.016966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:06.016932    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy" containerID="cri-o://bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27" gracePeriod=30
Oct 30 20:18:06.110748 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:06.110667    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:07.930714 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:07.930672    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:08.118638 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.118597    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:08.290569 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.290474    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:08.481269 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.481233    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"]
Oct 30 20:18:08.484787 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.484761    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:18:08.509060 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.506590    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj28v\" (UniqueName: \"kubernetes.io/projected/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-kube-api-access-rj28v\") pod \"payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8\" (UID: \"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:18:08.509517 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.509488    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8\" (UID: \"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:18:08.538020 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.537114    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w0-e4864d-dockercfg-smfz2\""
Oct 30 20:18:08.538020 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.537195    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w0-e4864d\""
Oct 30 20:18:08.601404 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.601358    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"]
Oct 30 20:18:08.611175 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.611135    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8\" (UID: \"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:18:08.611431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.611413    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj28v\" (UniqueName: \"kubernetes.io/projected/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-kube-api-access-rj28v\") pod \"payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8\" (UID: \"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:18:08.612035 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.612009    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8\" (UID: \"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:18:08.671341 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.671304    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj28v\" (UniqueName: \"kubernetes.io/projected/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-kube-api-access-rj28v\") pod \"payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8\" (UID: \"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:18:08.820456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:08.820426    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:18:09.198939 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:09.198839    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"]
Oct 30 20:18:09.204972 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:18:09.204943    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1df9240_cf13_4bb4_ae92_54fa1ccfe3fb.slice/crio-4c8a484f0377138d54d5dd8408e2c790c7ea7797ede37965d73ce98e2892e786 WatchSource:0}: Error finding container 4c8a484f0377138d54d5dd8408e2c790c7ea7797ede37965d73ce98e2892e786: Status 404 returned error can't find the container with id 4c8a484f0377138d54d5dd8408e2c790c7ea7797ede37965d73ce98e2892e786
Oct 30 20:18:09.828376 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:09.828335    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8" event={"ID":"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb","Type":"ContainerStarted","Data":"b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130"}
Oct 30 20:18:09.828553 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:09.828395    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8" event={"ID":"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb","Type":"ContainerStarted","Data":"4c8a484f0377138d54d5dd8408e2c790c7ea7797ede37965d73ce98e2892e786"}
Oct 30 20:18:09.828553 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:09.828422    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:18:09.940534 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:09.940480    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8" podStartSLOduration=1.940463626 podStartE2EDuration="1.940463626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:09.938864713 +0000 UTC m=+3152.481671979" watchObservedRunningTime="2026-10-30 20:18:09.940463626 +0000 UTC m=+3152.483270891"
Oct 30 20:18:11.295789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.295764    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:18:11.348373 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.348336    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-envoy\") pod \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") "
Oct 30 20:18:11.348551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.348446    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-token\" (UniqueName: \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-token\") pod \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") "
Oct 30 20:18:11.348551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.348512    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-podinfo\") pod \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") "
Oct 30 20:18:11.348679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.348548    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-data\") pod \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") "
Oct 30 20:18:11.348679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.348660    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-certs\") pod \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") "
Oct 30 20:18:11.348793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.348705    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-socket\") pod \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") "
Oct 30 20:18:11.348793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.348758    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istiod-ca-cert\") pod \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") "
Oct 30 20:18:11.348943 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.348880    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-credential-socket\") pod \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") "
Oct 30 20:18:11.348943 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.348907    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-certs" pod "f5b83e30-b72d-43b2-a980-b3fcf111d8d7" (UID: "f5b83e30-b72d-43b2-a980-b3fcf111d8d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:18:11.349044 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.348926    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-data" pod "f5b83e30-b72d-43b2-a980-b3fcf111d8d7" (UID: "f5b83e30-b72d-43b2-a980-b3fcf111d8d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:18:11.349044 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.348972    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-kube-api-access-q8mg4\" (UniqueName: \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-kube-api-access-q8mg4\") pod \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\" (UID: \"f5b83e30-b72d-43b2-a980-b3fcf111d8d7\") "
Oct 30 20:18:11.349792 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.349659    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-credential-socket" pod "f5b83e30-b72d-43b2-a980-b3fcf111d8d7" (UID: "f5b83e30-b72d-43b2-a980-b3fcf111d8d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:18:11.349792 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.349687    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istiod-ca-cert" pod "f5b83e30-b72d-43b2-a980-b3fcf111d8d7" (UID: "f5b83e30-b72d-43b2-a980-b3fcf111d8d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:18:11.349792 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.349743    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-socket" pod "f5b83e30-b72d-43b2-a980-b3fcf111d8d7" (UID: "f5b83e30-b72d-43b2-a980-b3fcf111d8d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:18:11.351480 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.351455    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:18:11.351595 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.351483    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:18:11.351595 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.351499    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:18:11.351595 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.351514    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:18:11.351595 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.351535    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:18:11.352311 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.352283    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-podinfo" pod "f5b83e30-b72d-43b2-a980-b3fcf111d8d7" (UID: "f5b83e30-b72d-43b2-a980-b3fcf111d8d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:18:11.352311 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.352285    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-token" pod "f5b83e30-b72d-43b2-a980-b3fcf111d8d7" (UID: "f5b83e30-b72d-43b2-a980-b3fcf111d8d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:18:11.352461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.352310    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-kube-api-access-q8mg4" pod "f5b83e30-b72d-43b2-a980-b3fcf111d8d7" (UID: "f5b83e30-b72d-43b2-a980-b3fcf111d8d7"). InnerVolumeSpecName "kube-api-access-q8mg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:18:11.359989 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.359957    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-envoy" pod "f5b83e30-b72d-43b2-a980-b3fcf111d8d7" (UID: "f5b83e30-b72d-43b2-a980-b3fcf111d8d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:18:11.452899 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.452857    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8mg4\" (UniqueName: \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-kube-api-access-q8mg4\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:18:11.453104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.452902    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:18:11.453104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.452934    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:18:11.453104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.452949    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5b83e30-b72d-43b2-a980-b3fcf111d8d7-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:18:11.843945 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.843856    6015 generic.go:356] "Generic (PLEG): container finished" podID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerID="bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27" exitCode=0
Oct 30 20:18:11.843945 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.843931    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"
Oct 30 20:18:11.844167 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.843933    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" event={"ID":"f5b83e30-b72d-43b2-a980-b3fcf111d8d7","Type":"ContainerDied","Data":"bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27"}
Oct 30 20:18:11.844167 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.844059    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct" event={"ID":"f5b83e30-b72d-43b2-a980-b3fcf111d8d7","Type":"ContainerDied","Data":"4a1bb1ac257f19eca69181bac097bacca80d0c36a901e7a06b7da336e1a4446a"}
Oct 30 20:18:11.844167 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.844083    6015 scope.go:122] "RemoveContainer" containerID="bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27"
Oct 30 20:18:11.854356 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.854334    6015 scope.go:122] "RemoveContainer" containerID="321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2"
Oct 30 20:18:11.864301 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.864279    6015 scope.go:122] "RemoveContainer" containerID="bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27"
Oct 30 20:18:11.864628 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:18:11.864609    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27\": container with ID starting with bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27 not found: ID does not exist" containerID="bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27"
Oct 30 20:18:11.864664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.864637    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27"} err="failed to get container status \"bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27\": rpc error: code = NotFound desc = could not find container \"bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27\": container with ID starting with bb266a3f55c2cecd4faee0d97b2ba40ffc700b2c6ea121b1d3394913ec84be27 not found: ID does not exist"
Oct 30 20:18:11.864664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.864658    6015 scope.go:122] "RemoveContainer" containerID="321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2"
Oct 30 20:18:11.864951 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:18:11.864931    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2\": container with ID starting with 321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2 not found: ID does not exist" containerID="321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2"
Oct 30 20:18:11.864999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:11.864958    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2"} err="failed to get container status \"321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2\": rpc error: code = NotFound desc = could not find container \"321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2\": container with ID starting with 321041cc493cbf66b2106535f4e883ec3954c69baae2b846af980eb5a541baf2 not found: ID does not exist"
Oct 30 20:18:12.003563 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:12.003523    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"]
Oct 30 20:18:12.008389 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:12.008356    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-praxis-a-d5d3ba-openshift-default-66c66f9745-4vgct"]
Oct 30 20:18:13.165394 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:13.165357    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:13.586516 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:13.586479    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" path="/var/lib/kubelet/pods/f5b83e30-b72d-43b2-a980-b3fcf111d8d7/volumes"
Oct 30 20:18:14.364506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:14.364472    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:14.520051 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:14.519963    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:17.954469 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:17.954386    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:20.839416 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:20.839386    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:18:22.668319 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:22.668282    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:25.991002 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:25.990962    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:26.217019 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:26.216965    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:27.631372 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:27.631338    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:28.216420 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:18:28.216382    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:18:28.242090 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:28.242060    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:28.698122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:28.698087    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:29.332438 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.332397    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"]
Oct 30 20:18:29.333247 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.333217    6015 cpu_manager.go:414] "containerMap: removing container" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy"
Oct 30 20:18:29.333247 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.333245    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy"
Oct 30 20:18:29.333426 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.333265    6015 cpu_manager.go:414] "containerMap: removing container" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy"
Oct 30 20:18:29.333426 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.333271    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy"
Oct 30 20:18:29.333426 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.333395    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy"
Oct 30 20:18:29.333426 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.333405    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5b83e30-b72d-43b2-a980-b3fcf111d8d7" containerName="istio-proxy"
Oct 30 20:18:29.337190 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.337169    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.391216 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.391180    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-fe49e7-openshift-default-dockercfg-6p8s6\""
Oct 30 20:18:29.468097 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.468061    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"]
Oct 30 20:18:29.494822 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.494774    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj5n2\" (UniqueName: \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-kube-api-access-vj5n2\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.495011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.494949    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-socket\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.495160 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.495141    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/887c8955-1084-476d-bd4f-80b005dc02b4-istio-podinfo\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.495221 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.495187    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-envoy\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.495264 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.495229    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-credential-socket\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.495324 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.495307    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/887c8955-1084-476d-bd4f-80b005dc02b4-istiod-ca-cert\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.495406 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.495391    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-data\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.495446 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.495422    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-certs\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.495483 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.495449    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-istio-token\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.513210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.513165    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:29.596884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.596791    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj5n2\" (UniqueName: \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-kube-api-access-vj5n2\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597044 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.596902    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-socket\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597044 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597030    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/887c8955-1084-476d-bd4f-80b005dc02b4-istio-podinfo\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597134 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597056    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-envoy\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597211 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597192    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-credential-socket\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597271 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597250    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/887c8955-1084-476d-bd4f-80b005dc02b4-istiod-ca-cert\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597282    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-socket\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597314    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-data\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597436 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597350    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-certs\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597436 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597376    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-istio-token\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597544 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597485    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-credential-socket\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597643 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597618    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-data\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597749 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597724    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-certs\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.597912 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.597892    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/887c8955-1084-476d-bd4f-80b005dc02b4-istiod-ca-cert\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.599443 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.599422    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-envoy\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.599669 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.599651    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/887c8955-1084-476d-bd4f-80b005dc02b4-istio-podinfo\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.655539 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.655501    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj5n2\" (UniqueName: \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-kube-api-access-vj5n2\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.655712 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.655620    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-istio-token\") pod \"e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") " pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:29.771478 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.771433    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:29.948865 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.948766    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:29.950744 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:29.950721    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:30.382562 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:30.382522    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"]
Oct 30 20:18:30.387932 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:18:30.387904    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887c8955_1084_476d_bd4f_80b005dc02b4.slice/crio-ff02d88caaba50b4fb1661cefc9e9b3c3e458b956fa2a2c0930e985c68a16e04 WatchSource:0}: Error finding container ff02d88caaba50b4fb1661cefc9e9b3c3e458b956fa2a2c0930e985c68a16e04: Status 404 returned error can't find the container with id ff02d88caaba50b4fb1661cefc9e9b3c3e458b956fa2a2c0930e985c68a16e04
Oct 30 20:18:30.390617 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:30.390582    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:18:30.390733 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:30.390670    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:18:30.390733 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:30.390715    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:18:30.999357 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:30.999316    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" event={"ID":"887c8955-1084-476d-bd4f-80b005dc02b4","Type":"ContainerStarted","Data":"5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58"}
Oct 30 20:18:30.999883 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:30.999384    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" event={"ID":"887c8955-1084-476d-bd4f-80b005dc02b4","Type":"ContainerStarted","Data":"ff02d88caaba50b4fb1661cefc9e9b3c3e458b956fa2a2c0930e985c68a16e04"}
Oct 30 20:18:31.162500 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:31.162444    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" podStartSLOduration=2.162428597 podStartE2EDuration="2.162428597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:31.161253316 +0000 UTC m=+3173.704060583" watchObservedRunningTime="2026-10-30 20:18:31.162428597 +0000 UTC m=+3173.705235861"
Oct 30 20:18:31.951658 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:31.951613    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:31.957934 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:31.957909    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:32.014888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:32.014790    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:32.017769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:32.017710    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:18:32.846280 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:32.846248    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:34.413787 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:34.413752    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:34.641501 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:34.641460    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:35.009700 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.009659    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:35.559746 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.559713    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"]
Oct 30 20:18:35.563131 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.563108    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.624694 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.624642    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w1-b37684-openshift-default-dockercfg-vhx8c\""
Oct 30 20:18:35.674562 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.674460    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:35.677603 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.677570    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"]
Oct 30 20:18:35.685539 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.685498    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-credential-socket\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.685796 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.685774    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-data\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.686095 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.686056    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-envoy\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.686400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.686364    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-podinfo\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.686524 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.686510    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-certs\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.686744 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.686730    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-socket\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.686929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.686881    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-token\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.687069 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.687053    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istiod-ca-cert\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.687182 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.687167    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cncdr\" (UniqueName: \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-kube-api-access-cncdr\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.789275 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.789235    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-envoy\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.789471 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.789343    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-podinfo\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.789471 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.789385    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-certs\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.789471 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.789462    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-socket\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.789614 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.789501    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-token\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.789614 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.789535    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istiod-ca-cert\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.789614 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.789566    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cncdr\" (UniqueName: \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-kube-api-access-cncdr\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.789771 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.789728    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-credential-socket\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.789771 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.789760    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-data\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.789940 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.789856    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-certs\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.789940 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.789887    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-socket\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.790272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.790248    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-credential-socket\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.790391 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.790369    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-data\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.790742 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.790721    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istiod-ca-cert\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.791969 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.791945    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-envoy\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.792312 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.792292    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-podinfo\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.845082 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.844964    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:35.852417 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.852376    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-token\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.858603 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.858564    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cncdr\" (UniqueName: \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-kube-api-access-cncdr\") pod \"e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") " pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:35.882206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:35.882170    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:36.325590 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:36.325552    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"]
Oct 30 20:18:36.330915 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:18:36.330878    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef4ad1c_72c9_4faf_9894_665936b7dc51.slice/crio-3dc4f48eeb35c2e121307459f8f0167fe2c42e4f88828b8d39014e910cf4763f WatchSource:0}: Error finding container 3dc4f48eeb35c2e121307459f8f0167fe2c42e4f88828b8d39014e910cf4763f: Status 404 returned error can't find the container with id 3dc4f48eeb35c2e121307459f8f0167fe2c42e4f88828b8d39014e910cf4763f
Oct 30 20:18:36.333540 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:36.333502    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:18:36.333638 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:36.333576    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:18:36.333638 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:36.333606    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:18:37.046475 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:37.046431    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" event={"ID":"4ef4ad1c-72c9-4faf-9894-665936b7dc51","Type":"ContainerStarted","Data":"11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc"}
Oct 30 20:18:37.046951 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:37.046498    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" event={"ID":"4ef4ad1c-72c9-4faf-9894-665936b7dc51","Type":"ContainerStarted","Data":"3dc4f48eeb35c2e121307459f8f0167fe2c42e4f88828b8d39014e910cf4763f"}
Oct 30 20:18:37.212784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:37.212718    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" podStartSLOduration=2.212703751 podStartE2EDuration="2.212703751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:18:37.20963928 +0000 UTC m=+3179.752446573" watchObservedRunningTime="2026-10-30 20:18:37.212703751 +0000 UTC m=+3179.755511017"
Oct 30 20:18:37.882622 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:37.882573    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:37.889452 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:37.889422    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:37.974347 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:37.974295    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:38.054420 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:38.054391    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:38.055532 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:38.055488    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:18:38.387701 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:38.387651    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:38.625944 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:38.625905    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:38.718896 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:38.717131    6015 scope.go:122] "RemoveContainer" containerID="c036ed7304db7a3f60097ebefc6ddc6519b2d1776ee149555ad51c1685cba10b"
Oct 30 20:18:40.698002 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:40.697935    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:40.893098 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:40.893062    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:41.055549 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:41.055484    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:43.379582 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:43.379542    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:44.093840 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:44.092614    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:44.334539 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:44.334499    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:45.511905 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:45.511868    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:45.970908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:45.970869    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:46.670528 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:46.670490    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:47.067262 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:47.067229    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:48.609014 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:48.608965    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:51.107444 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:51.107398    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:51.335657 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:51.335615    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:53.624404 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:53.624364    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:54.416663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:54.416611    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:54.648676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:54.648627    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:57.104687 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:57.104647    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:58.216849 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:18:58.216799    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:18:58.537135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:58.537033    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:18:58.753155 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:18:58.753116    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:03.569989 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:03.569948    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:07.638997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:07.638960    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:09.489531 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:09.489485    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:09.710213 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:09.710175    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:09.881856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:09.881787    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:10.421564 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:10.421520    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:14.372714 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:14.372674    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:17.896904 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:17.895797    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:18.381587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:18.381478    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:18.636059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:18.635967    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:19.297644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:19.297603    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:23.973924 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:23.973879    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:25.498459 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:25.498417    6015 generic.go:356] "Generic (PLEG): container finished" podID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerID="e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02" exitCode=0
Oct 30 20:19:25.499050 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:25.498490    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" event={"ID":"88448a71-1695-4c8e-9eea-7acf648d9f0f","Type":"ContainerDied","Data":"e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02"}
Oct 30 20:19:25.499050 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:25.498975    6015 scope.go:122] "RemoveContainer" containerID="e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02"
Oct 30 20:19:25.500703 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:25.500676    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:19:25.500782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:25.500749    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:19:25.500860 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:25.500783    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:19:26.507574 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:26.507528    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" event={"ID":"88448a71-1695-4c8e-9eea-7acf648d9f0f","Type":"ContainerStarted","Data":"60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed"}
Oct 30 20:19:26.790275 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:26.790140    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:19:26.790477 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:26.790353    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.139:15021/healthz/ready\": dial tcp 10.134.0.139:15021: connect: connection refused" start-of-body=
Oct 30 20:19:26.790477 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:26.790414    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.139:15021/healthz/ready\": dial tcp 10.134.0.139:15021: connect: connection refused"
Oct 30 20:19:27.785832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:27.785286    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.139:15021/healthz/ready\": dial tcp 10.134.0.139:15021: connect: connection refused" start-of-body=
Oct 30 20:19:27.785832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:27.785365    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.139:15021/healthz/ready\": dial tcp 10.134.0.139:15021: connect: connection refused"
Oct 30 20:19:28.219827 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:19:28.219771    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:19:28.549421 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:28.549384    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:28.763953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:28.763910    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:28.790273 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:28.790227    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.139:15021/healthz/ready\": dial tcp 10.134.0.139:15021: connect: connection refused" start-of-body=
Oct 30 20:19:28.790883 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:28.790326    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.139:15021/healthz/ready\": dial tcp 10.134.0.139:15021: connect: connection refused"
Oct 30 20:19:29.779275 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:29.779232    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.139:15021/healthz/ready\": dial tcp 10.134.0.139:15021: connect: connection refused" start-of-body=
Oct 30 20:19:29.779581 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:29.779548    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.139:15021/healthz/ready\": dial tcp 10.134.0.139:15021: connect: connection refused"
Oct 30 20:19:30.781283 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:30.781234    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.139:15021/healthz/ready\": dial tcp 10.134.0.139:15021: connect: connection refused" start-of-body=
Oct 30 20:19:30.781839 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:30.781307    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.139:15021/healthz/ready\": dial tcp 10.134.0.139:15021: connect: connection refused"
Oct 30 20:19:31.824837 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:31.824749    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:19:31.825795 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:31.825547    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:19:31.827379 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:31.827357    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:19:33.363014 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:33.362975    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:35.822508 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:35.822463    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:36.482957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:36.482922    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:36.725576 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:36.725503    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:38.263757 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:38.263717    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:41.465256 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:41.465213    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:41.662898 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:41.662845    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:41.866045 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:41.866004    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:43.381246 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:43.381198    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:43.548243 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:43.548212    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:43.766371 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:43.766267    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:46.690905 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:46.690545    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:46.878206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:46.878170    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:47.092398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.092361    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"]
Oct 30 20:19:47.096121 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.096098    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:19:47.265723 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.265677    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-4b0bf3-dockercfg-sm86s\""
Oct 30 20:19:47.266192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.266165    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-4b0bf3\""
Oct 30 20:19:47.282655 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.267334    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx\" (UID: \"ab31d8b3-dc99-4f20-bf93-93b9728c0cff\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:19:47.284906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.283028    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6lgc\" (UniqueName: \"kubernetes.io/projected/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-kube-api-access-w6lgc\") pod \"payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx\" (UID: \"ab31d8b3-dc99-4f20-bf93-93b9728c0cff\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:19:47.287386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.275883    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"]
Oct 30 20:19:47.289614 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.289560    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"]
Oct 30 20:19:47.295159 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.295130    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:19:47.305903 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.305868    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"]
Oct 30 20:19:47.386005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.385913    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e908203b-a583-46f9-9ce2-b6a35be86328-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v\" (UID: \"e908203b-a583-46f9-9ce2-b6a35be86328\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:19:47.386187 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.386005    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx\" (UID: \"ab31d8b3-dc99-4f20-bf93-93b9728c0cff\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:19:47.386187 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.386069    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6lgc\" (UniqueName: \"kubernetes.io/projected/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-kube-api-access-w6lgc\") pod \"payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx\" (UID: \"ab31d8b3-dc99-4f20-bf93-93b9728c0cff\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:19:47.386187 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.386091    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54nvq\" (UniqueName: \"kubernetes.io/projected/e908203b-a583-46f9-9ce2-b6a35be86328-kube-api-access-54nvq\") pod \"payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v\" (UID: \"e908203b-a583-46f9-9ce2-b6a35be86328\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:19:47.386962 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.386937    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx\" (UID: \"ab31d8b3-dc99-4f20-bf93-93b9728c0cff\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:19:47.453242 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.453207    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6lgc\" (UniqueName: \"kubernetes.io/projected/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-kube-api-access-w6lgc\") pod \"payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx\" (UID: \"ab31d8b3-dc99-4f20-bf93-93b9728c0cff\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:19:47.487256 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.487214    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54nvq\" (UniqueName: \"kubernetes.io/projected/e908203b-a583-46f9-9ce2-b6a35be86328-kube-api-access-54nvq\") pod \"payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v\" (UID: \"e908203b-a583-46f9-9ce2-b6a35be86328\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:19:47.487468 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.487378    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e908203b-a583-46f9-9ce2-b6a35be86328-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v\" (UID: \"e908203b-a583-46f9-9ce2-b6a35be86328\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:19:47.488091 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.488071    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e908203b-a583-46f9-9ce2-b6a35be86328-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v\" (UID: \"e908203b-a583-46f9-9ce2-b6a35be86328\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:19:47.557892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.557842    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54nvq\" (UniqueName: \"kubernetes.io/projected/e908203b-a583-46f9-9ce2-b6a35be86328-kube-api-access-54nvq\") pod \"payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v\" (UID: \"e908203b-a583-46f9-9ce2-b6a35be86328\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:19:47.615169 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.615117    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:19:47.715831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:47.709008    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:19:48.102966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:48.102930    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"]
Oct 30 20:19:48.108156 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:19:48.108128    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode908203b_a583_46f9_9ce2_b6a35be86328.slice/crio-a0d59cae22819d48327baa4f216188247c3b0f876cca9048b73ae087ee9c6925 WatchSource:0}: Error finding container a0d59cae22819d48327baa4f216188247c3b0f876cca9048b73ae087ee9c6925: Status 404 returned error can't find the container with id a0d59cae22819d48327baa4f216188247c3b0f876cca9048b73ae087ee9c6925
Oct 30 20:19:48.218544 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:48.218513    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"]
Oct 30 20:19:48.223718 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:19:48.223687    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab31d8b3_dc99_4f20_bf93_93b9728c0cff.slice/crio-a0da79140421224454c6047bc04962c8bad0f8389426b835be6a6cae18cbef21 WatchSource:0}: Error finding container a0da79140421224454c6047bc04962c8bad0f8389426b835be6a6cae18cbef21: Status 404 returned error can't find the container with id a0da79140421224454c6047bc04962c8bad0f8389426b835be6a6cae18cbef21
Oct 30 20:19:48.683833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:48.682785    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:48.731094 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:48.731035    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v" event={"ID":"e908203b-a583-46f9-9ce2-b6a35be86328","Type":"ContainerStarted","Data":"1631579fa69ac71e61eccb2e92a1b83621076ef01fc2f38c342a2578db42c948"}
Oct 30 20:19:48.731554 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:48.731159    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v" event={"ID":"e908203b-a583-46f9-9ce2-b6a35be86328","Type":"ContainerStarted","Data":"a0d59cae22819d48327baa4f216188247c3b0f876cca9048b73ae087ee9c6925"}
Oct 30 20:19:48.731554 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:48.731202    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:19:48.733631 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:48.733589    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx" event={"ID":"ab31d8b3-dc99-4f20-bf93-93b9728c0cff","Type":"ContainerStarted","Data":"d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b"}
Oct 30 20:19:48.733771 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:48.733665    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:19:48.733771 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:48.733687    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx" event={"ID":"ab31d8b3-dc99-4f20-bf93-93b9728c0cff","Type":"ContainerStarted","Data":"a0da79140421224454c6047bc04962c8bad0f8389426b835be6a6cae18cbef21"}
Oct 30 20:19:48.844717 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:48.844660    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v" podStartSLOduration=1.844646033 podStartE2EDuration="1.844646033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:19:48.843158977 +0000 UTC m=+3251.385966242" watchObservedRunningTime="2026-10-30 20:19:48.844646033 +0000 UTC m=+3251.387453298"
Oct 30 20:19:48.955675 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:48.955556    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx" podStartSLOduration=1.9555361279999999 podStartE2EDuration="1.955536128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:19:48.955230937 +0000 UTC m=+3251.498038203" watchObservedRunningTime="2026-10-30 20:19:48.955536128 +0000 UTC m=+3251.498343392"
Oct 30 20:19:53.778387 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:53.778345    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:56.840450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:56.840415    6015 generic.go:356] "Generic (PLEG): container finished" podID="887c8955-1084-476d-bd4f-80b005dc02b4" containerID="5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58" exitCode=0
Oct 30 20:19:56.840933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:56.840492    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" event={"ID":"887c8955-1084-476d-bd4f-80b005dc02b4","Type":"ContainerDied","Data":"5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58"}
Oct 30 20:19:56.840980 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:56.840964    6015 scope.go:122] "RemoveContainer" containerID="5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58"
Oct 30 20:19:56.842637 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:56.842607    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:19:56.842701 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:56.842680    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:19:56.842741 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:56.842710    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:19:57.589417 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:57.589377    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:57.849030 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:57.848941    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" event={"ID":"887c8955-1084-476d-bd4f-80b005dc02b4","Type":"ContainerStarted","Data":"00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff"}
Oct 30 20:19:57.951375 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:57.951335    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:19:57.953001 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:57.952973    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused" start-of-body=
Oct 30 20:19:57.953137 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:57.953037    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused"
Oct 30 20:19:58.217451 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:19:58.217365    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:19:58.747169 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:58.747129    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:58.952248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:58.952216    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused" start-of-body=
Oct 30 20:19:58.952876 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:58.952291    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused"
Oct 30 20:19:58.979493 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:58.979459    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:19:59.745579 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:59.745548    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:19:59.745794 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:59.745724    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:19:59.951751 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:59.951716    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused" start-of-body=
Oct 30 20:19:59.951956 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:19:59.951794    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused"
Oct 30 20:20:00.951731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:00.951688    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused" start-of-body=
Oct 30 20:20:00.952302 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:00.951753    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused"
Oct 30 20:20:01.951659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:01.951614    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused" start-of-body=
Oct 30 20:20:01.951898 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:01.951679    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused"
Oct 30 20:20:02.014764 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:02.014728    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:20:02.951729 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:02.951689    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused" start-of-body=
Oct 30 20:20:02.951949 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:02.951762    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.141:15021/healthz/ready\": dial tcp 10.134.0.141:15021: connect: connection refused"
Oct 30 20:20:03.956917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:03.956883    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:20:03.958252 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:03.958221    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:20:04.048108 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:04.048064    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:09.061988 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:09.061949    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:13.880250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:13.880208    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:17.726469 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:17.726413    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:18.974866 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:18.974831    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:22.119390 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:22.119344    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:23.833294 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:23.833249    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:24.096148 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:24.096041    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:20:24.096148 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:24.096111    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:20:27.084241 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:27.084209    6015 generic.go:356] "Generic (PLEG): container finished" podID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerID="11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc" exitCode=0
Oct 30 20:20:27.084698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:27.084285    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" event={"ID":"4ef4ad1c-72c9-4faf-9894-665936b7dc51","Type":"ContainerDied","Data":"11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc"}
Oct 30 20:20:27.084781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:27.084762    6015 scope.go:122] "RemoveContainer" containerID="11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc"
Oct 30 20:20:27.086485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:27.086456    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:20:27.086576 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:27.086523    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:20:27.086576 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:27.086559    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:20:28.099400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:28.099361    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" event={"ID":"4ef4ad1c-72c9-4faf-9894-665936b7dc51","Type":"ContainerStarted","Data":"1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e"}
Oct 30 20:20:28.219738 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:20:28.219699    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:20:28.493201 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:28.492779    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:28.887833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:28.884167    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:20:28.887833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:28.884297    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 20:20:28.887833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:28.884343    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 20:20:29.884842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:29.884359    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 20:20:29.884842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:29.884443    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 20:20:30.884338 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:30.884293    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 20:20:30.884786 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:30.884754    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 20:20:31.883841 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:31.883234    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 20:20:31.883841 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:31.883316    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 20:20:32.890309 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:32.890265    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused" start-of-body=
Oct 30 20:20:32.890884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:32.890339    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.142:15021/healthz/ready\": dial tcp 10.134.0.142:15021: connect: connection refused"
Oct 30 20:20:33.163307 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:33.163208    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:33.887219 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:33.887186    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:20:33.887497 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:33.887475    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:20:33.888203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:33.888186    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:20:37.902104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:37.902057    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:41.397486 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:41.397447    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:42.468425 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:42.468347    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:47.273290 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:47.273245    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:47.488477 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:47.488440    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:52.023384 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:52.023344    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:52.181543 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:52.181503    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:52.335557 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:52.335526    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:56.828604 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:56.828554    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:57.802891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:20:57.802851    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:20:58.219196 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:20:58.219104    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:21:01.538987 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:01.538944    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:03.531638 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:03.531597    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:06.454058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:06.454014    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:11.267050 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:11.266993    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:15.978336 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:15.978230    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:19.579897 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:19.579852    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:21.115330 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:21.115291    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:24.353308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:24.353263    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:25.827691 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:25.827642    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:28.216987 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:21:28.216952    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:21:30.458663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:30.458623    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:35.156571 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:35.156534    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:39.750173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:39.750132    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:44.477706 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:44.477668    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:49.061649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:49.061605    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:51.344535 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:51.344494    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:53.659689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:53.659656    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:58.136615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:58.136581    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:21:58.218172 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:21:58.218134    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:21:58.309581 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:21:58.309537    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:02.858603 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:02.858556    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:07.488922 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:07.488882    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:09.926119 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:09.926082    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:12.259535 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:12.259485    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:12.604450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:12.604412    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:16.436441 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:16.436400    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"]
Oct 30 20:22:16.437085 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:16.436673    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerName="istio-proxy" containerID="cri-o://2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0" gracePeriod=30
Oct 30 20:22:16.483446 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:16.483403    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"]
Oct 30 20:22:16.483736 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:16.483694    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerName="istio-proxy" containerID="cri-o://e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1" gracePeriod=30
Oct 30 20:22:16.855596 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:16.855558    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:20.684522 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:20.684486    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"]
Oct 30 20:22:20.685043 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:20.684708    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerName="istio-proxy" containerID="cri-o://f56b0f5edf06e2d9b05150bf26fd0a4ca3c8204898a7d68cad3678ddb90f1795" gracePeriod=30
Oct 30 20:22:20.732334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:20.732297    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"]
Oct 30 20:22:20.732563 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:20.732512    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerName="istio-proxy" containerID="cri-o://5cfa7b66af1aeacb4f146755d05fe2a73e672e28d24888fe0cbf6396d5144f70" gracePeriod=30
Oct 30 20:22:20.736639 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:20.736607    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"]
Oct 30 20:22:20.736882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:20.736858    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerName="istio-proxy" containerID="cri-o://da567e77baaad3c7fb04e01eef240d97eb543d4bedc7c1c5d2931789dac44b9b" gracePeriod=30
Oct 30 20:22:20.778616 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:20.778572    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"]
Oct 30 20:22:20.778864 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:20.778793    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" podUID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" containerName="istio-proxy" containerID="cri-o://7073b395103fef86215593fae12f46e7e86bfade8378f8b90d6d7eda8f8ffcd5" gracePeriod=30
Oct 30 20:22:20.991380 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:20.991288    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:22:20.991380 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:20.991358    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:22:21.373591 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.373549    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:21.617763 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.617731    6015 patch_prober.go:29] interesting pod/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused" start-of-body=
Oct 30 20:22:21.620649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.617794    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.131:15021/healthz/ready\": dial tcp 10.134.0.131:15021: connect: connection refused"
Oct 30 20:22:21.805352 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.805314    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:22:21.808880 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.808859    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:22:21.952198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.952107    6015 generic.go:356] "Generic (PLEG): container finished" podID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerID="2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0" exitCode=0
Oct 30 20:22:21.952198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.952167    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"
Oct 30 20:22:21.952198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.952186    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" event={"ID":"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a","Type":"ContainerDied","Data":"2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0"}
Oct 30 20:22:21.952482 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.952251    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc" event={"ID":"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a","Type":"ContainerDied","Data":"2048aac7bb4903edd30293c0eb0fdeda332586814aeb52293b0ea553dfa64bdc"}
Oct 30 20:22:21.952482 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.952282    6015 scope.go:122] "RemoveContainer" containerID="2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0"
Oct 30 20:22:21.953851 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.953826    6015 generic.go:356] "Generic (PLEG): container finished" podID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerID="e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1" exitCode=0
Oct 30 20:22:21.953968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.953872    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" event={"ID":"9dd76943-6db1-4796-90e6-b54c5df4949b","Type":"ContainerDied","Data":"e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1"}
Oct 30 20:22:21.953968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.953885    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"
Oct 30 20:22:21.953968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.953951    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s" event={"ID":"9dd76943-6db1-4796-90e6-b54c5df4949b","Type":"ContainerDied","Data":"690b604f12fb199daa635ece69f512aa7f2bfca7cf1d7beffeb3bd342657e478"}
Oct 30 20:22:21.965498 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.965466    6015 scope.go:122] "RemoveContainer" containerID="2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0"
Oct 30 20:22:21.965860 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:22:21.965837    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0\": container with ID starting with 2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0 not found: ID does not exist" containerID="2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0"
Oct 30 20:22:21.965960 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.965874    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0"} err="failed to get container status \"2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0\": rpc error: code = NotFound desc = could not find container \"2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0\": container with ID starting with 2e87693819da9552cc6f7082baaa6d91ac29860b2bf66571de3cd634c74016b0 not found: ID does not exist"
Oct 30 20:22:21.965960 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.965899    6015 scope.go:122] "RemoveContainer" containerID="e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1"
Oct 30 20:22:21.977282 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.977261    6015 scope.go:122] "RemoveContainer" containerID="e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1"
Oct 30 20:22:21.977622 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:22:21.977600    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1\": container with ID starting with e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1 not found: ID does not exist" containerID="e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1"
Oct 30 20:22:21.977681 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.977632    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1"} err="failed to get container status \"e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1\": rpc error: code = NotFound desc = could not find container \"e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1\": container with ID starting with e0cc12e82c3eb0bcf0546db97ae901da2315dcb07f2af31f6db39020391b0ca1 not found: ID does not exist"
Oct 30 20:22:21.995079 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995052    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-kube-api-access-hj9v7\" (UniqueName: \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-kube-api-access-hj9v7\") pod \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") "
Oct 30 20:22:21.995245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995109    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-podinfo\") pod \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") "
Oct 30 20:22:21.995245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995136    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9dd76943-6db1-4796-90e6-b54c5df4949b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd76943-6db1-4796-90e6-b54c5df4949b-istiod-ca-cert\") pod \"9dd76943-6db1-4796-90e6-b54c5df4949b\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") "
Oct 30 20:22:21.995373 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995243    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-credential-socket\") pod \"9dd76943-6db1-4796-90e6-b54c5df4949b\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") "
Oct 30 20:22:21.995373 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995317    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-certs\") pod \"9dd76943-6db1-4796-90e6-b54c5df4949b\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") "
Oct 30 20:22:21.995373 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995355    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istiod-ca-cert\") pod \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") "
Oct 30 20:22:21.995543 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995409    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-podinfo\") pod \"9dd76943-6db1-4796-90e6-b54c5df4949b\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") "
Oct 30 20:22:21.995543 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995484    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-data\") pod \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") "
Oct 30 20:22:21.995543 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995530    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-socket\") pod \"9dd76943-6db1-4796-90e6-b54c5df4949b\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") "
Oct 30 20:22:21.995698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995518    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-credential-socket" pod "9dd76943-6db1-4796-90e6-b54c5df4949b" (UID: "9dd76943-6db1-4796-90e6-b54c5df4949b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:21.995698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995549    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dd76943-6db1-4796-90e6-b54c5df4949b-istiod-ca-cert" pod "9dd76943-6db1-4796-90e6-b54c5df4949b" (UID: "9dd76943-6db1-4796-90e6-b54c5df4949b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:22:21.995698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995573    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-token\" (UniqueName: \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-token\") pod \"9dd76943-6db1-4796-90e6-b54c5df4949b\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") "
Oct 30 20:22:21.995698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995614    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-credential-socket\") pod \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") "
Oct 30 20:22:21.995698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995606    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-certs" pod "9dd76943-6db1-4796-90e6-b54c5df4949b" (UID: "9dd76943-6db1-4796-90e6-b54c5df4949b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:21.995698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995649    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-token\" (UniqueName: \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-token\") pod \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") "
Oct 30 20:22:21.996215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995730    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-envoy\") pod \"9dd76943-6db1-4796-90e6-b54c5df4949b\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") "
Oct 30 20:22:21.996215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995722    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-socket" pod "9dd76943-6db1-4796-90e6-b54c5df4949b" (UID: "9dd76943-6db1-4796-90e6-b54c5df4949b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:21.996215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995785    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-data\") pod \"9dd76943-6db1-4796-90e6-b54c5df4949b\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") "
Oct 30 20:22:21.996215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995841    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-kube-api-access-v6svk\" (UniqueName: \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-kube-api-access-v6svk\") pod \"9dd76943-6db1-4796-90e6-b54c5df4949b\" (UID: \"9dd76943-6db1-4796-90e6-b54c5df4949b\") "
Oct 30 20:22:21.996215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995876    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-socket\") pod \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") "
Oct 30 20:22:21.996215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995785    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-data" pod "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" (UID: "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:21.996215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995907    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-envoy\") pod \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") "
Oct 30 20:22:21.996215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.996071    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istiod-ca-cert" pod "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" (UID: "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:22:21.996215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.996116    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-certs\") pod \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\" (UID: \"5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a\") "
Oct 30 20:22:21.997192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.996346    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-data" pod "9dd76943-6db1-4796-90e6-b54c5df4949b" (UID: "9dd76943-6db1-4796-90e6-b54c5df4949b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:21.997192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.996931    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:21.997192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.996954    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:21.997192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.996968    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:21.997192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.996983    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:21.997192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.996997    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd76943-6db1-4796-90e6-b54c5df4949b-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:21.997192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.997012    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:21.997192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.997025    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:21.997192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.995887    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-credential-socket" pod "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" (UID: "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:21.997192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.997149    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-socket" pod "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" (UID: "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:21.997742 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.997220    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-certs" pod "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" (UID: "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:21.997945 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.997926    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-podinfo" pod "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" (UID: "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:22:21.998553 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.998533    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-kube-api-access-hj9v7" pod "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" (UID: "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a"). InnerVolumeSpecName "kube-api-access-hj9v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:21.998742 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:21.998723    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-token" pod "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" (UID: "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:22.000150 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.000121    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-envoy" pod "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" (UID: "5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:22.000150 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.000128    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-podinfo" pod "9dd76943-6db1-4796-90e6-b54c5df4949b" (UID: "9dd76943-6db1-4796-90e6-b54c5df4949b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:22:22.000150 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.000135    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-envoy" pod "9dd76943-6db1-4796-90e6-b54c5df4949b" (UID: "9dd76943-6db1-4796-90e6-b54c5df4949b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:22.000324 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.000236    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-kube-api-access-v6svk" pod "9dd76943-6db1-4796-90e6-b54c5df4949b" (UID: "9dd76943-6db1-4796-90e6-b54c5df4949b"). InnerVolumeSpecName "kube-api-access-v6svk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:22.000324 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.000257    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-token" pod "9dd76943-6db1-4796-90e6-b54c5df4949b" (UID: "9dd76943-6db1-4796-90e6-b54c5df4949b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:22.098534 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.098500    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:22.098534 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.098531    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:22.098534 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.098541    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:22.098779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.098550    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:22.098779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.098559    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd76943-6db1-4796-90e6-b54c5df4949b-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:22.098779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.098569    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6svk\" (UniqueName: \"kubernetes.io/projected/9dd76943-6db1-4796-90e6-b54c5df4949b-kube-api-access-v6svk\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:22.098779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.098579    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:22.098779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.098588    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:22.098779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.098596    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:22.098779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.098604    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj9v7\" (UniqueName: \"kubernetes.io/projected/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-kube-api-access-hj9v7\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:22.098779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.098612    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:22.372518 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.372473    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"]
Oct 30 20:22:22.376718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.376690    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-b7flc"]
Oct 30 20:22:22.495251 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.495182    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"]
Oct 30 20:22:22.498478 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:22.498444    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a74d15-openshift-default-6659bdd657-mnc2s"]
Oct 30 20:22:23.588415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:23.588377    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" path="/var/lib/kubelet/pods/5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a/volumes"
Oct 30 20:22:23.589145 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:23.589126    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" path="/var/lib/kubelet/pods/9dd76943-6db1-4796-90e6-b54c5df4949b/volumes"
Oct 30 20:22:25.973388 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:22:25.970369    6015 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f4f0cb_ae81_4f27_9799_0513b638968e.slice/crio-5cfa7b66af1aeacb4f146755d05fe2a73e672e28d24888fe0cbf6396d5144f70.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f4f0cb_ae81_4f27_9799_0513b638968e.slice/crio-conmon-5cfa7b66af1aeacb4f146755d05fe2a73e672e28d24888fe0cbf6396d5144f70.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 20:22:25.994842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:25.990435    6015 generic.go:356] "Generic (PLEG): container finished" podID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerID="f56b0f5edf06e2d9b05150bf26fd0a4ca3c8204898a7d68cad3678ddb90f1795" exitCode=0
Oct 30 20:22:25.994842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:25.990558    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" event={"ID":"754fe397-b5f4-41d7-86d3-97215c2ff9e9","Type":"ContainerDied","Data":"f56b0f5edf06e2d9b05150bf26fd0a4ca3c8204898a7d68cad3678ddb90f1795"}
Oct 30 20:22:25.994842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:25.992760    6015 generic.go:356] "Generic (PLEG): container finished" podID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerID="5cfa7b66af1aeacb4f146755d05fe2a73e672e28d24888fe0cbf6396d5144f70" exitCode=0
Oct 30 20:22:25.994842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:25.992898    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" event={"ID":"c7f4f0cb-ae81-4f27-9799-0513b638968e","Type":"ContainerDied","Data":"5cfa7b66af1aeacb4f146755d05fe2a73e672e28d24888fe0cbf6396d5144f70"}
Oct 30 20:22:26.008849 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:25.995768    6015 generic.go:356] "Generic (PLEG): container finished" podID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerID="da567e77baaad3c7fb04e01eef240d97eb543d4bedc7c1c5d2931789dac44b9b" exitCode=0
Oct 30 20:22:26.008849 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:25.995925    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" event={"ID":"35f9ece5-2bcf-4d5c-8b3c-9157f227c682","Type":"ContainerDied","Data":"da567e77baaad3c7fb04e01eef240d97eb543d4bedc7c1c5d2931789dac44b9b"}
Oct 30 20:22:26.008849 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:25.998188    6015 generic.go:356] "Generic (PLEG): container finished" podID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" containerID="7073b395103fef86215593fae12f46e7e86bfade8378f8b90d6d7eda8f8ffcd5" exitCode=0
Oct 30 20:22:26.008849 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:25.998339    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" event={"ID":"1c63c98d-bb30-4e3d-a80e-f509c851dabc","Type":"ContainerDied","Data":"7073b395103fef86215593fae12f46e7e86bfade8378f8b90d6d7eda8f8ffcd5"}
Oct 30 20:22:26.027938 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.027908    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:22:26.047612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.047571    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-envoy\") pod \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") "
Oct 30 20:22:26.047828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.047761    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-kube-api-access-6b47r\" (UniqueName: \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-kube-api-access-6b47r\") pod \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") "
Oct 30 20:22:26.047921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.047851    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-data\") pod \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") "
Oct 30 20:22:26.047990 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.047975    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-credential-socket\") pod \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") "
Oct 30 20:22:26.048074 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.048057    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-podinfo\") pod \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") "
Oct 30 20:22:26.048165 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.048149    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-token\" (UniqueName: \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-token\") pod \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") "
Oct 30 20:22:26.048229 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.048203    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istiod-ca-cert\") pod \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") "
Oct 30 20:22:26.048292 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.048237    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-certs\") pod \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") "
Oct 30 20:22:26.048292 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.048235    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-data" pod "754fe397-b5f4-41d7-86d3-97215c2ff9e9" (UID: "754fe397-b5f4-41d7-86d3-97215c2ff9e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.048526 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.048503    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-credential-socket" pod "754fe397-b5f4-41d7-86d3-97215c2ff9e9" (UID: "754fe397-b5f4-41d7-86d3-97215c2ff9e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.048632 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.048614    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-socket\") pod \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\" (UID: \"754fe397-b5f4-41d7-86d3-97215c2ff9e9\") "
Oct 30 20:22:26.049308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.049285    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.049415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.049311    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.049846 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.049821    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-socket" pod "754fe397-b5f4-41d7-86d3-97215c2ff9e9" (UID: "754fe397-b5f4-41d7-86d3-97215c2ff9e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.049931 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.049891    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istiod-ca-cert" pod "754fe397-b5f4-41d7-86d3-97215c2ff9e9" (UID: "754fe397-b5f4-41d7-86d3-97215c2ff9e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:22:26.050060 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.050041    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-certs" pod "754fe397-b5f4-41d7-86d3-97215c2ff9e9" (UID: "754fe397-b5f4-41d7-86d3-97215c2ff9e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.051353 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.051330    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-token" pod "754fe397-b5f4-41d7-86d3-97215c2ff9e9" (UID: "754fe397-b5f4-41d7-86d3-97215c2ff9e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:26.051504 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.051480    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-envoy" pod "754fe397-b5f4-41d7-86d3-97215c2ff9e9" (UID: "754fe397-b5f4-41d7-86d3-97215c2ff9e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.053178 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.053132    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-kube-api-access-6b47r" pod "754fe397-b5f4-41d7-86d3-97215c2ff9e9" (UID: "754fe397-b5f4-41d7-86d3-97215c2ff9e9"). InnerVolumeSpecName "kube-api-access-6b47r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:26.054505 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.054345    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-podinfo" pod "754fe397-b5f4-41d7-86d3-97215c2ff9e9" (UID: "754fe397-b5f4-41d7-86d3-97215c2ff9e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:22:26.068261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.068233    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:26.139854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.139783    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:22:26.150747 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.150719    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.150747 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.150747    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.150966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.150760    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.150966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.150769    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.150966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.150778    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.150966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.150786    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/754fe397-b5f4-41d7-86d3-97215c2ff9e9-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.150966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.150795    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b47r\" (UniqueName: \"kubernetes.io/projected/754fe397-b5f4-41d7-86d3-97215c2ff9e9-kube-api-access-6b47r\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.179742 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.179716    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:22:26.181064 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.181045    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 20:22:26.251942 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.251861    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-envoy\") pod \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") "
Oct 30 20:22:26.251942 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.251915    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-podinfo\") pod \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") "
Oct 30 20:22:26.251942 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.251937    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-token\" (UniqueName: \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-token\") pod \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") "
Oct 30 20:22:26.252189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.251958    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-credential-socket\") pod \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") "
Oct 30 20:22:26.252189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.251995    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-kube-api-access-5zsts\" (UniqueName: \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-kube-api-access-5zsts\") pod \"c7f4f0cb-ae81-4f27-9799-0513b638968e\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") "
Oct 30 20:22:26.252189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252015    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-credential-socket\") pod \"c7f4f0cb-ae81-4f27-9799-0513b638968e\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") "
Oct 30 20:22:26.252189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252045    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-envoy\") pod \"c7f4f0cb-ae81-4f27-9799-0513b638968e\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") "
Oct 30 20:22:26.252189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252072    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-certs\") pod \"c7f4f0cb-ae81-4f27-9799-0513b638968e\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") "
Oct 30 20:22:26.252189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252099    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-token\" (UniqueName: \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-token\") pod \"c7f4f0cb-ae81-4f27-9799-0513b638968e\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") "
Oct 30 20:22:26.252189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252129    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istiod-ca-cert\") pod \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") "
Oct 30 20:22:26.252189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252161    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-data\") pod \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") "
Oct 30 20:22:26.252587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252203    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-socket\") pod \"c7f4f0cb-ae81-4f27-9799-0513b638968e\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") "
Oct 30 20:22:26.252587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252231    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-certs\") pod \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") "
Oct 30 20:22:26.252587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252284    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7f4f0cb-ae81-4f27-9799-0513b638968e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7f4f0cb-ae81-4f27-9799-0513b638968e-istiod-ca-cert\") pod \"c7f4f0cb-ae81-4f27-9799-0513b638968e\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") "
Oct 30 20:22:26.252587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252296    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-credential-socket" pod "1c63c98d-bb30-4e3d-a80e-f509c851dabc" (UID: "1c63c98d-bb30-4e3d-a80e-f509c851dabc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.252587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252314    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-data\") pod \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") "
Oct 30 20:22:26.252587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252388    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-kube-api-access-zlv6f\" (UniqueName: \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-kube-api-access-zlv6f\") pod \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") "
Oct 30 20:22:26.252587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252426    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-data\") pod \"c7f4f0cb-ae81-4f27-9799-0513b638968e\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") "
Oct 30 20:22:26.252587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252481    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-credential-socket" pod "c7f4f0cb-ae81-4f27-9799-0513b638968e" (UID: "c7f4f0cb-ae81-4f27-9799-0513b638968e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.252587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252513    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-data" pod "35f9ece5-2bcf-4d5c-8b3c-9157f227c682" (UID: "35f9ece5-2bcf-4d5c-8b3c-9157f227c682"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.252587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252528    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-socket\") pod \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") "
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252606    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-token\" (UniqueName: \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-token\") pod \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") "
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252651    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istiod-ca-cert\") pod \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") "
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252684    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-certs" pod "c7f4f0cb-ae81-4f27-9799-0513b638968e" (UID: "c7f4f0cb-ae81-4f27-9799-0513b638968e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252694    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-certs\") pod \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") "
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252730    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-kube-api-access-lgkqz\" (UniqueName: \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-kube-api-access-lgkqz\") pod \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") "
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252759    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-socket\") pod \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") "
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.252829    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f4f0cb-ae81-4f27-9799-0513b638968e-istiod-ca-cert" pod "c7f4f0cb-ae81-4f27-9799-0513b638968e" (UID: "c7f4f0cb-ae81-4f27-9799-0513b638968e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.253015    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-socket" pod "c7f4f0cb-ae81-4f27-9799-0513b638968e" (UID: "c7f4f0cb-ae81-4f27-9799-0513b638968e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.253083    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-certs" pod "35f9ece5-2bcf-4d5c-8b3c-9157f227c682" (UID: "35f9ece5-2bcf-4d5c-8b3c-9157f227c682"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.253278    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-socket" pod "35f9ece5-2bcf-4d5c-8b3c-9157f227c682" (UID: "35f9ece5-2bcf-4d5c-8b3c-9157f227c682"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.253311    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-data" pod "1c63c98d-bb30-4e3d-a80e-f509c851dabc" (UID: "1c63c98d-bb30-4e3d-a80e-f509c851dabc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.253366    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istiod-ca-cert" pod "35f9ece5-2bcf-4d5c-8b3c-9157f227c682" (UID: "35f9ece5-2bcf-4d5c-8b3c-9157f227c682"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.253678    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-certs" pod "1c63c98d-bb30-4e3d-a80e-f509c851dabc" (UID: "1c63c98d-bb30-4e3d-a80e-f509c851dabc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.253717    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istiod-ca-cert" pod "1c63c98d-bb30-4e3d-a80e-f509c851dabc" (UID: "1c63c98d-bb30-4e3d-a80e-f509c851dabc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.253768    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-data" pod "c7f4f0cb-ae81-4f27-9799-0513b638968e" (UID: "c7f4f0cb-ae81-4f27-9799-0513b638968e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.253870    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-credential-socket\") pod \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\" (UID: \"35f9ece5-2bcf-4d5c-8b3c-9157f227c682\") "
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.253980    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-socket" pod "1c63c98d-bb30-4e3d-a80e-f509c851dabc" (UID: "1c63c98d-bb30-4e3d-a80e-f509c851dabc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254035    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-podinfo\") pod \"c7f4f0cb-ae81-4f27-9799-0513b638968e\" (UID: \"c7f4f0cb-ae81-4f27-9799-0513b638968e\") "
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254097    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-podinfo\") pod \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") "
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254134    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-credential-socket" pod "35f9ece5-2bcf-4d5c-8b3c-9157f227c682" (UID: "35f9ece5-2bcf-4d5c-8b3c-9157f227c682"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254150    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-envoy\") pod \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\" (UID: \"1c63c98d-bb30-4e3d-a80e-f509c851dabc\") "
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254770    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254791    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254822    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254835    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254847    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254860    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7f4f0cb-ae81-4f27-9799-0513b638968e-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254874    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254886    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254899    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254913    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254926    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254938    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254950    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254962    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.255089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.254975    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.256483 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.255663    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-token" pod "c7f4f0cb-ae81-4f27-9799-0513b638968e" (UID: "c7f4f0cb-ae81-4f27-9799-0513b638968e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:26.256483 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.255695    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-token" pod "1c63c98d-bb30-4e3d-a80e-f509c851dabc" (UID: "1c63c98d-bb30-4e3d-a80e-f509c851dabc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:26.257182 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.257145    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-kube-api-access-5zsts" pod "c7f4f0cb-ae81-4f27-9799-0513b638968e" (UID: "c7f4f0cb-ae81-4f27-9799-0513b638968e"). InnerVolumeSpecName "kube-api-access-5zsts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:26.257295 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.257175    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-kube-api-access-zlv6f" pod "35f9ece5-2bcf-4d5c-8b3c-9157f227c682" (UID: "35f9ece5-2bcf-4d5c-8b3c-9157f227c682"). InnerVolumeSpecName "kube-api-access-zlv6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:26.257364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.257304    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-envoy" pod "35f9ece5-2bcf-4d5c-8b3c-9157f227c682" (UID: "35f9ece5-2bcf-4d5c-8b3c-9157f227c682"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.257364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.257316    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-envoy" pod "c7f4f0cb-ae81-4f27-9799-0513b638968e" (UID: "c7f4f0cb-ae81-4f27-9799-0513b638968e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.257364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.257337    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-token" pod "35f9ece5-2bcf-4d5c-8b3c-9157f227c682" (UID: "35f9ece5-2bcf-4d5c-8b3c-9157f227c682"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:26.257475 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.257448    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-kube-api-access-lgkqz" pod "1c63c98d-bb30-4e3d-a80e-f509c851dabc" (UID: "1c63c98d-bb30-4e3d-a80e-f509c851dabc"). InnerVolumeSpecName "kube-api-access-lgkqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:22:26.257629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.257607    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-podinfo" pod "1c63c98d-bb30-4e3d-a80e-f509c851dabc" (UID: "1c63c98d-bb30-4e3d-a80e-f509c851dabc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:22:26.257629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.257617    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-podinfo" pod "35f9ece5-2bcf-4d5c-8b3c-9157f227c682" (UID: "35f9ece5-2bcf-4d5c-8b3c-9157f227c682"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:22:26.258765 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.258745    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-podinfo" pod "c7f4f0cb-ae81-4f27-9799-0513b638968e" (UID: "c7f4f0cb-ae81-4f27-9799-0513b638968e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:22:26.259065 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.259047    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-envoy" pod "1c63c98d-bb30-4e3d-a80e-f509c851dabc" (UID: "1c63c98d-bb30-4e3d-a80e-f509c851dabc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:22:26.356497 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356465    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.356497 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356495    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.356497 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356505    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.356745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356514    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.356745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356524    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zsts\" (UniqueName: \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-kube-api-access-5zsts\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.356745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356533    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.356745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356542    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.356745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356550    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlv6f\" (UniqueName: \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-kube-api-access-zlv6f\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.356745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356558    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35f9ece5-2bcf-4d5c-8b3c-9157f227c682-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.356745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356568    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgkqz\" (UniqueName: \"kubernetes.io/projected/1c63c98d-bb30-4e3d-a80e-f509c851dabc-kube-api-access-lgkqz\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.356745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356576    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7f4f0cb-ae81-4f27-9799-0513b638968e-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:26.356745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:26.356585    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c63c98d-bb30-4e3d-a80e-f509c851dabc-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:22:27.007297 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.007199    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"
Oct 30 20:22:27.007297 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.007211    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8" event={"ID":"754fe397-b5f4-41d7-86d3-97215c2ff9e9","Type":"ContainerDied","Data":"6f71a9820f22b233962b6dc38829f5c37586f61bf39b82cbe587e94e73415a56"}
Oct 30 20:22:27.007297 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.007278    6015 scope.go:122] "RemoveContainer" containerID="f56b0f5edf06e2d9b05150bf26fd0a4ca3c8204898a7d68cad3678ddb90f1795"
Oct 30 20:22:27.009506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.009213    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"
Oct 30 20:22:27.009506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.009237    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd" event={"ID":"c7f4f0cb-ae81-4f27-9799-0513b638968e","Type":"ContainerDied","Data":"4918e4207575762f5fec51c0b22f25e0bb02c7e27eaa2238304b7aa934ac089b"}
Oct 30 20:22:27.013855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.011356    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"
Oct 30 20:22:27.013855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.011385    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm" event={"ID":"35f9ece5-2bcf-4d5c-8b3c-9157f227c682","Type":"ContainerDied","Data":"ec03abdfdbe348914a5c9f3912cedc74cf8225d400299c9b7e7b6fce73998c17"}
Oct 30 20:22:27.015479 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.015455    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8" event={"ID":"1c63c98d-bb30-4e3d-a80e-f509c851dabc","Type":"ContainerDied","Data":"bb625a19a1a950b4ae7eca2170c521a6083c4b5fd330e1646a769893d9ea37de"}
Oct 30 20:22:27.015585 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.015490    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"
Oct 30 20:22:27.021755 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.021727    6015 scope.go:122] "RemoveContainer" containerID="5cfa7b66af1aeacb4f146755d05fe2a73e672e28d24888fe0cbf6396d5144f70"
Oct 30 20:22:27.032436 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.032417    6015 scope.go:122] "RemoveContainer" containerID="da567e77baaad3c7fb04e01eef240d97eb543d4bedc7c1c5d2931789dac44b9b"
Oct 30 20:22:27.042372 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.042351    6015 scope.go:122] "RemoveContainer" containerID="7073b395103fef86215593fae12f46e7e86bfade8378f8b90d6d7eda8f8ffcd5"
Oct 30 20:22:27.198558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.198505    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"]
Oct 30 20:22:27.243384 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.243335    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8qmpd"]
Oct 30 20:22:27.325572 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.325529    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"]
Oct 30 20:22:27.329068 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.329035    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-fdrr8"]
Oct 30 20:22:27.433881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.433842    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"]
Oct 30 20:22:27.437305 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.437276    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-sf8k8"]
Oct 30 20:22:27.541031 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.540995    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"]
Oct 30 20:22:27.545738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.545708    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-98a19b-openshift-default-775879c667-8m4pm"]
Oct 30 20:22:27.587386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.587302    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" path="/var/lib/kubelet/pods/1c63c98d-bb30-4e3d-a80e-f509c851dabc/volumes"
Oct 30 20:22:27.587889 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.587870    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" path="/var/lib/kubelet/pods/35f9ece5-2bcf-4d5c-8b3c-9157f227c682/volumes"
Oct 30 20:22:27.588365 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.588351    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" path="/var/lib/kubelet/pods/754fe397-b5f4-41d7-86d3-97215c2ff9e9/volumes"
Oct 30 20:22:27.589206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:27.589189    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" path="/var/lib/kubelet/pods/c7f4f0cb-ae81-4f27-9799-0513b638968e/volumes"
Oct 30 20:22:28.215306 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:22:28.215268    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:22:30.671204 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:30.671158    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:32.810771 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:32.810728    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:35.739515 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:35.739479    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:36.226087 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226054    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"]
Oct 30 20:22:36.226634 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226621    6015 cpu_manager.go:414] "containerMap: removing container" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerName="istio-proxy"
Oct 30 20:22:36.226724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226635    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerName="istio-proxy"
Oct 30 20:22:36.226724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226661    6015 cpu_manager.go:414] "containerMap: removing container" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerName="istio-proxy"
Oct 30 20:22:36.226724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226668    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerName="istio-proxy"
Oct 30 20:22:36.226724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226679    6015 cpu_manager.go:414] "containerMap: removing container" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerName="istio-proxy"
Oct 30 20:22:36.226724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226684    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerName="istio-proxy"
Oct 30 20:22:36.226724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226700    6015 cpu_manager.go:414] "containerMap: removing container" podUID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" containerName="istio-proxy"
Oct 30 20:22:36.226724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226706    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" containerName="istio-proxy"
Oct 30 20:22:36.226724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226714    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerName="istio-proxy"
Oct 30 20:22:36.226724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226719    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerName="istio-proxy"
Oct 30 20:22:36.227122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226729    6015 cpu_manager.go:414] "containerMap: removing container" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerName="istio-proxy"
Oct 30 20:22:36.227122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226734    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerName="istio-proxy"
Oct 30 20:22:36.227122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226880    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="9dd76943-6db1-4796-90e6-b54c5df4949b" containerName="istio-proxy"
Oct 30 20:22:36.227122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226893    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7f4f0cb-ae81-4f27-9799-0513b638968e" containerName="istio-proxy"
Oct 30 20:22:36.227122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226906    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="35f9ece5-2bcf-4d5c-8b3c-9157f227c682" containerName="istio-proxy"
Oct 30 20:22:36.227122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226915    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="1c63c98d-bb30-4e3d-a80e-f509c851dabc" containerName="istio-proxy"
Oct 30 20:22:36.227122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226922    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ef0f5d3-6a04-4b7f-9cd9-c5bbe873567a" containerName="istio-proxy"
Oct 30 20:22:36.227122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.226928    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="754fe397-b5f4-41d7-86d3-97215c2ff9e9" containerName="istio-proxy"
Oct 30 20:22:36.230933 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.230910    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.282373 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.282335    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w0-e4864d\"/\"auth-test-model-e4864d-kserve-self-signed-certs\""
Oct 30 20:22:36.283073 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.283046    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w0-e4864d\"/\"default-dockercfg-8dvs6\""
Oct 30 20:22:36.328883 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.328850    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w0-e4864d\"/\"openshift-service-ca.crt\""
Oct 30 20:22:36.329072 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.328919    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w0-e4864d\"/\"kube-root-ca.crt\""
Oct 30 20:22:36.331625 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.331600    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"]
Oct 30 20:22:36.333307 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.333281    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:36.392100 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.392057    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-dshm\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.392289 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.392174    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b155e6-0d06-49d8-8fc3-15026299710d-tls-certs\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.392289 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.392243    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-tmp-dir\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.392384 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.392318    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gts5s\" (UniqueName: \"kubernetes.io/projected/44b155e6-0d06-49d8-8fc3-15026299710d-kube-api-access-gts5s\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.392384 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.392368    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-home\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.392463 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.392421    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-model-cache\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.493647 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.493542    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b155e6-0d06-49d8-8fc3-15026299710d-tls-certs\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.493647 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.493616    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-tmp-dir\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.493911 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.493677    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gts5s\" (UniqueName: \"kubernetes.io/projected/44b155e6-0d06-49d8-8fc3-15026299710d-kube-api-access-gts5s\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.493911 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.493723    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-home\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.493911 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.493801    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-model-cache\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.494066 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.493945    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-dshm\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.494598 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.494544    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-model-cache\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.494927 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.494903    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-tmp-dir\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.495134 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.495116    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-home\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.496856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.496793    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-dshm\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.496963 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.496867    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b155e6-0d06-49d8-8fc3-15026299710d-tls-certs\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.552541 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.552504    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gts5s\" (UniqueName: \"kubernetes.io/projected/44b155e6-0d06-49d8-8fc3-15026299710d-kube-api-access-gts5s\") pod \"auth-test-model-e4864d-kserve-779b8c449c-6td79\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") " pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:36.844025 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:36.843982    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:37.223062 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:37.222980    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"]
Oct 30 20:22:37.228860 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:22:37.228830    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44b155e6_0d06_49d8_8fc3_15026299710d.slice/crio-adbe3b8f59bd69d80a37357a8ce571e1b916b52d7a3b60682519395fe09b2d14 WatchSource:0}: Error finding container adbe3b8f59bd69d80a37357a8ce571e1b916b52d7a3b60682519395fe09b2d14: Status 404 returned error can't find the container with id adbe3b8f59bd69d80a37357a8ce571e1b916b52d7a3b60682519395fe09b2d14
Oct 30 20:22:38.090427 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:38.090384    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79" event={"ID":"44b155e6-0d06-49d8-8fc3-15026299710d","Type":"ContainerStarted","Data":"464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93"}
Oct 30 20:22:38.090427 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:38.090434    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79" event={"ID":"44b155e6-0d06-49d8-8fc3-15026299710d","Type":"ContainerStarted","Data":"adbe3b8f59bd69d80a37357a8ce571e1b916b52d7a3b60682519395fe09b2d14"}
Oct 30 20:22:38.205731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:38.205675    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79" podStartSLOduration=2.205661338 podStartE2EDuration="2.205661338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:22:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:22:38.203599845 +0000 UTC m=+3420.746407111" watchObservedRunningTime="2026-10-30 20:22:38.205661338 +0000 UTC m=+3420.748468602"
Oct 30 20:22:38.844947 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:38.844922    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:40.243125 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:40.243091    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:44.879554 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:44.879514    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:45.811919 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:45.811874    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:46.844436 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:46.844387    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:46.857299 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:46.857272    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:47.158231 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:47.158142    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:22:49.378901 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:49.378849    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:53.961460 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:53.961420    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:55.682900 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.682858    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"]
Oct 30 20:22:55.688182 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.688151    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.784501 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.784464    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:55.784837 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.784484    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-4b0bf3\"/\"openshift-service-ca.crt\""
Oct 30 20:22:55.784837 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.784570    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-4b0bf3\"/\"kube-root-ca.crt\""
Oct 30 20:22:55.784837 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.784617    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-4b0bf3\"/\"explicit-model-4b0bf3-kserve-self-signed-certs\""
Oct 30 20:22:55.784837 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.784662    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-4b0bf3\"/\"default-dockercfg-gggxv\""
Oct 30 20:22:55.787460 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.787438    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"]
Oct 30 20:22:55.863940 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.863905    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-home\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.864122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.864038    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-dshm\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.864122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.864100    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74jrr\" (UniqueName: \"kubernetes.io/projected/1c85b66c-066c-4742-8217-05f528fc2d7b-kube-api-access-74jrr\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.864202 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.864145    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-tmp-dir\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.864242 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.864200    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-model-cache\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.864242 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.864235    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c85b66c-066c-4742-8217-05f528fc2d7b-tls-certs\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.965543 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.965443    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-model-cache\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.965543 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.965505    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c85b66c-066c-4742-8217-05f528fc2d7b-tls-certs\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.965798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.965639    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-home\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.965798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.965728    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-dshm\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.965798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.965762    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74jrr\" (UniqueName: \"kubernetes.io/projected/1c85b66c-066c-4742-8217-05f528fc2d7b-kube-api-access-74jrr\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.965798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.965844    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-tmp-dir\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.966077 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.965993    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-model-cache\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.966077 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.966026    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-home\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.966199 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.966154    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-tmp-dir\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.968188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.968163    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-dshm\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:55.968559 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:55.968535    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c85b66c-066c-4742-8217-05f528fc2d7b-tls-certs\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:56.024869 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:56.024831    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74jrr\" (UniqueName: \"kubernetes.io/projected/1c85b66c-066c-4742-8217-05f528fc2d7b-kube-api-access-74jrr\") pod \"explicit-model-4b0bf3-kserve-8469d8c497-8vn5w\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") " pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:56.300589 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:56.300555    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:56.682180 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:56.682101    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"]
Oct 30 20:22:56.688001 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:22:56.687973    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c85b66c_066c_4742_8217_05f528fc2d7b.slice/crio-2671d2d849962efd7337e14407667dc03570dd7441c975bc8e9891521eb304f3 WatchSource:0}: Error finding container 2671d2d849962efd7337e14407667dc03570dd7441c975bc8e9891521eb304f3: Status 404 returned error can't find the container with id 2671d2d849962efd7337e14407667dc03570dd7441c975bc8e9891521eb304f3
Oct 30 20:22:57.259049 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:57.259010    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w" event={"ID":"1c85b66c-066c-4742-8217-05f528fc2d7b","Type":"ContainerStarted","Data":"9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab"}
Oct 30 20:22:57.259239 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:57.259058    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w" event={"ID":"1c85b66c-066c-4742-8217-05f528fc2d7b","Type":"ContainerStarted","Data":"2671d2d849962efd7337e14407667dc03570dd7441c975bc8e9891521eb304f3"}
Oct 30 20:22:57.301122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:57.301082    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:22:57.379418 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:57.379363    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w" podStartSLOduration=2.379348832 podStartE2EDuration="2.379348832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:22:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:22:57.377520022 +0000 UTC m=+3439.920327292" watchObservedRunningTime="2026-10-30 20:22:57.379348832 +0000 UTC m=+3439.922156097"
Oct 30 20:22:58.217283 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:22:58.217242    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:22:58.495537 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:58.495443    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:22:58.677194 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:22:58.677148    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:03.099613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:03.099563    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:06.300873 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:06.300833    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:23:06.314104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:06.314073    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:23:06.337410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:06.337376    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:23:07.981418 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:07.981380    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:12.422310 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:12.422255    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:16.955053 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:16.955014    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:21.645794 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:21.645756    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:26.159611 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:26.159566    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:28.217185 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:23:28.217148    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:23:30.683748 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:30.683710    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:33.609660 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.609614    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"]
Oct 30 20:23:33.613913 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.613889    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.664265 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.664218    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-fe49e7\"/\"openshift-service-ca.crt\""
Oct 30 20:23:33.708696 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.708665    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-fe49e7\"/\"kube-root-ca.crt\""
Oct 30 20:23:33.710894 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.710866    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-fe49e7\"/\"default-dockercfg-nwjl7\""
Oct 30 20:23:33.710894 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.710866    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-fe49e7\"/\"auth-test-model-fe49e7-kserve-self-signed-certs\""
Oct 30 20:23:33.713578 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.713549    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"]
Oct 30 20:23:33.714499 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.714471    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:33.788193 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.788155    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-model-cache\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.788386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.788207    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wlcs\" (UniqueName: \"kubernetes.io/projected/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-kube-api-access-6wlcs\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.788386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.788271    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-dshm\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.788386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.788308    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tmp-dir\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.788530 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.788397    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-home\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.788530 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.788471    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tls-certs\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.889950 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.889850    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wlcs\" (UniqueName: \"kubernetes.io/projected/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-kube-api-access-6wlcs\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.889950 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.889904    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-dshm\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.889950 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.889930    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tmp-dir\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.890389 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.890065    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-home\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.890389 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.890102    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tls-certs\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.890389 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.890216    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-model-cache\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.890611 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.890463    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tmp-dir\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.890611 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.890529    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-home\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.890611 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.890587    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-model-cache\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.892946 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.892921    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-dshm\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.893072 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.892987    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tls-certs\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:33.948620 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:33.948583    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wlcs\" (UniqueName: \"kubernetes.io/projected/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-kube-api-access-6wlcs\") pod \"auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") " pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:34.227100 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:34.226995    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:34.610879 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:34.610797    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"]
Oct 30 20:23:34.615735 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:23:34.615691    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffc6c70a_8f3e_4d28_88aa_049047f9c2a8.slice/crio-0b0245f35ef17d279ce0e2ca3cc49bab0820fd77416cf7aae391bab24dac3123 WatchSource:0}: Error finding container 0b0245f35ef17d279ce0e2ca3cc49bab0820fd77416cf7aae391bab24dac3123: Status 404 returned error can't find the container with id 0b0245f35ef17d279ce0e2ca3cc49bab0820fd77416cf7aae391bab24dac3123
Oct 30 20:23:35.462232 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:35.462195    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:35.524389 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:35.524346    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4" event={"ID":"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8","Type":"ContainerStarted","Data":"23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d"}
Oct 30 20:23:35.524389 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:35.524404    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4" event={"ID":"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8","Type":"ContainerStarted","Data":"0b0245f35ef17d279ce0e2ca3cc49bab0820fd77416cf7aae391bab24dac3123"}
Oct 30 20:23:35.635651 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:35.635595    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4" podStartSLOduration=2.635580955 podStartE2EDuration="2.635580955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:23:35.634645214 +0000 UTC m=+3478.177452478" watchObservedRunningTime="2026-10-30 20:23:35.635580955 +0000 UTC m=+3478.178388220"
Oct 30 20:23:36.227778 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:36.227739    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:40.365096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:40.365050    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:44.227747 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:44.227701    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:44.241000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:44.240961    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:44.601051 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:44.601019    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:23:45.001228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:45.001137    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:45.483096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:45.483060    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"]
Oct 30 20:23:45.592006 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:45.591924    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"]
Oct 30 20:23:45.874601 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:45.874561    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:46.034852 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:46.034817    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:49.551714 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:49.551679    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:50.483431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:50.483370    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v" podUID="e908203b-a583-46f9-9ce2-b6a35be86328" containerName="payload-processing" containerID="cri-o://1631579fa69ac71e61eccb2e92a1b83621076ef01fc2f38c342a2578db42c948" gracePeriod=25
Oct 30 20:23:50.593295 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:50.593242    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx" podUID="ab31d8b3-dc99-4f20-bf93-93b9728c0cff" containerName="payload-pre-processing" containerID="cri-o://d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b" gracePeriod=25
Oct 30 20:23:50.652530 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:50.652494    6015 generic.go:356] "Generic (PLEG): container finished" podID="e908203b-a583-46f9-9ce2-b6a35be86328" containerID="1631579fa69ac71e61eccb2e92a1b83621076ef01fc2f38c342a2578db42c948" exitCode=0
Oct 30 20:23:50.652688 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:50.652543    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v" event={"ID":"e908203b-a583-46f9-9ce2-b6a35be86328","Type":"ContainerDied","Data":"1631579fa69ac71e61eccb2e92a1b83621076ef01fc2f38c342a2578db42c948"}
Oct 30 20:23:50.753514 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:50.753432    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:23:50.880994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:50.880962    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:23:50.927111 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:50.927039    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e908203b-a583-46f9-9ce2-b6a35be86328-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e908203b-a583-46f9-9ce2-b6a35be86328-plugins-config-volume\") pod \"e908203b-a583-46f9-9ce2-b6a35be86328\" (UID: \"e908203b-a583-46f9-9ce2-b6a35be86328\") "
Oct 30 20:23:50.927397 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:50.927374    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e908203b-a583-46f9-9ce2-b6a35be86328-kube-api-access-54nvq\" (UniqueName: \"kubernetes.io/projected/e908203b-a583-46f9-9ce2-b6a35be86328-kube-api-access-54nvq\") pod \"e908203b-a583-46f9-9ce2-b6a35be86328\" (UID: \"e908203b-a583-46f9-9ce2-b6a35be86328\") "
Oct 30 20:23:50.927521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:50.927499    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e908203b-a583-46f9-9ce2-b6a35be86328-plugins-config-volume" pod "e908203b-a583-46f9-9ce2-b6a35be86328" (UID: "e908203b-a583-46f9-9ce2-b6a35be86328"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:23:50.927939 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:50.927920    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e908203b-a583-46f9-9ce2-b6a35be86328-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:23:50.929731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:50.929700    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e908203b-a583-46f9-9ce2-b6a35be86328-kube-api-access-54nvq" pod "e908203b-a583-46f9-9ce2-b6a35be86328" (UID: "e908203b-a583-46f9-9ce2-b6a35be86328"). InnerVolumeSpecName "kube-api-access-54nvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:23:51.029088 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.028990    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-plugins-config-volume\") pod \"ab31d8b3-dc99-4f20-bf93-93b9728c0cff\" (UID: \"ab31d8b3-dc99-4f20-bf93-93b9728c0cff\") "
Oct 30 20:23:51.029088 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.029048    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-kube-api-access-w6lgc\" (UniqueName: \"kubernetes.io/projected/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-kube-api-access-w6lgc\") pod \"ab31d8b3-dc99-4f20-bf93-93b9728c0cff\" (UID: \"ab31d8b3-dc99-4f20-bf93-93b9728c0cff\") "
Oct 30 20:23:51.029484 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.029459    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-plugins-config-volume" pod "ab31d8b3-dc99-4f20-bf93-93b9728c0cff" (UID: "ab31d8b3-dc99-4f20-bf93-93b9728c0cff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:23:51.029633 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.029617    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54nvq\" (UniqueName: \"kubernetes.io/projected/e908203b-a583-46f9-9ce2-b6a35be86328-kube-api-access-54nvq\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:23:51.029702 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.029640    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:23:51.031605 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.031582    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-kube-api-access-w6lgc" pod "ab31d8b3-dc99-4f20-bf93-93b9728c0cff" (UID: "ab31d8b3-dc99-4f20-bf93-93b9728c0cff"). InnerVolumeSpecName "kube-api-access-w6lgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:23:51.131826 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.131779    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6lgc\" (UniqueName: \"kubernetes.io/projected/ab31d8b3-dc99-4f20-bf93-93b9728c0cff-kube-api-access-w6lgc\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:23:51.661188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.661147    6015 generic.go:356] "Generic (PLEG): container finished" podID="ab31d8b3-dc99-4f20-bf93-93b9728c0cff" containerID="d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b" exitCode=0
Oct 30 20:23:51.661676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.661201    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"
Oct 30 20:23:51.661676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.661201    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx" event={"ID":"ab31d8b3-dc99-4f20-bf93-93b9728c0cff","Type":"ContainerDied","Data":"d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b"}
Oct 30 20:23:51.661676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.661266    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx" event={"ID":"ab31d8b3-dc99-4f20-bf93-93b9728c0cff","Type":"ContainerDied","Data":"a0da79140421224454c6047bc04962c8bad0f8389426b835be6a6cae18cbef21"}
Oct 30 20:23:51.661676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.661288    6015 scope.go:122] "RemoveContainer" containerID="d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b"
Oct 30 20:23:51.662953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.662872    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v" event={"ID":"e908203b-a583-46f9-9ce2-b6a35be86328","Type":"ContainerDied","Data":"a0d59cae22819d48327baa4f216188247c3b0f876cca9048b73ae087ee9c6925"}
Oct 30 20:23:51.662953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.662910    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"
Oct 30 20:23:51.671847 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.671798    6015 scope.go:122] "RemoveContainer" containerID="d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b"
Oct 30 20:23:51.672186 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:23:51.672160    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b\": container with ID starting with d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b not found: ID does not exist" containerID="d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b"
Oct 30 20:23:51.672298 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.672191    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b"} err="failed to get container status \"d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b\": rpc error: code = NotFound desc = could not find container \"d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b\": container with ID starting with d33c62066f533f351433ba6f6938cfd9ee630356704359384f7920fc28aed03b not found: ID does not exist"
Oct 30 20:23:51.672298 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.672208    6015 scope.go:122] "RemoveContainer" containerID="1631579fa69ac71e61eccb2e92a1b83621076ef01fc2f38c342a2578db42c948"
Oct 30 20:23:51.818949 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.818910    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"]
Oct 30 20:23:51.823420 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.823385    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b0bf3-74b7b874bd-cv64v"]
Oct 30 20:23:51.929176 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.929137    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"]
Oct 30 20:23:51.933373 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:51.933338    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4b0bf3-6fcf86dcff-5lmcx"]
Oct 30 20:23:53.589522 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:53.589489    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab31d8b3-dc99-4f20-bf93-93b9728c0cff" path="/var/lib/kubelet/pods/ab31d8b3-dc99-4f20-bf93-93b9728c0cff/volumes"
Oct 30 20:23:53.590073 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:53.590054    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e908203b-a583-46f9-9ce2-b6a35be86328" path="/var/lib/kubelet/pods/e908203b-a583-46f9-9ce2-b6a35be86328/volumes"
Oct 30 20:23:54.144893 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:54.144852    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:58.217926 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:23:58.217889    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:23:58.698504 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:58.698452    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:58.855656 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:58.855616    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:59.801151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:59.801116    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:23:59.958416 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:23:59.958382    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:02.000537 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:02.000501    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"]
Oct 30 20:24:02.029635 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:02.029598    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:03.224720 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.224681    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:03.712110 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.712071    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"]
Oct 30 20:24:03.712680 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.712664    6015 cpu_manager.go:414] "containerMap: removing container" podUID="ab31d8b3-dc99-4f20-bf93-93b9728c0cff" containerName="payload-pre-processing"
Oct 30 20:24:03.712680 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.712680    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab31d8b3-dc99-4f20-bf93-93b9728c0cff" containerName="payload-pre-processing"
Oct 30 20:24:03.712793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.712708    6015 cpu_manager.go:414] "containerMap: removing container" podUID="e908203b-a583-46f9-9ce2-b6a35be86328" containerName="payload-processing"
Oct 30 20:24:03.712793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.712713    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e908203b-a583-46f9-9ce2-b6a35be86328" containerName="payload-processing"
Oct 30 20:24:03.712880 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.712800    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab31d8b3-dc99-4f20-bf93-93b9728c0cff" containerName="payload-pre-processing"
Oct 30 20:24:03.712880 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.712833    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="e908203b-a583-46f9-9ce2-b6a35be86328" containerName="payload-processing"
Oct 30 20:24:03.717103 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.717080    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.767297 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.767248    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w1-b37684\"/\"kube-root-ca.crt\""
Oct 30 20:24:03.777412 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.777377    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w1-b37684\"/\"openshift-service-ca.crt\""
Oct 30 20:24:03.790357 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.790318    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e0c9a0d-1cf6-4a40-9591-81e467234036-tls-certs\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.790564 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.790375    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-dshm\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.790564 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.790493    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-model-cache\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.790704 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.790671    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvgz8\" (UniqueName: \"kubernetes.io/projected/3e0c9a0d-1cf6-4a40-9591-81e467234036-kube-api-access-bvgz8\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.790766 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.790711    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-tmp-dir\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.790883 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.790855    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-home\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.809523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.809485    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:03.813100 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.813075    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w1-b37684\"/\"default-dockercfg-ml2pg\""
Oct 30 20:24:03.813278 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.813241    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w1-b37684\"/\"auth-test-model-b37684-kserve-self-signed-certs\""
Oct 30 20:24:03.815888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.815863    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"]
Oct 30 20:24:03.892338 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.892306    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-model-cache\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.892516 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.892425    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvgz8\" (UniqueName: \"kubernetes.io/projected/3e0c9a0d-1cf6-4a40-9591-81e467234036-kube-api-access-bvgz8\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.892516 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.892451    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-tmp-dir\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.892516 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.892477    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-home\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.892669 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.892558    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e0c9a0d-1cf6-4a40-9591-81e467234036-tls-certs\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.892669 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.892598    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-dshm\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.892792 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.892754    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-model-cache\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.892950 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.892796    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-tmp-dir\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.892950 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.892906    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-home\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.895212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.895182    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-dshm\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.895546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.895524    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e0c9a0d-1cf6-4a40-9591-81e467234036-tls-certs\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:03.951603 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:03.951564    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvgz8\" (UniqueName: \"kubernetes.io/projected/3e0c9a0d-1cf6-4a40-9591-81e467234036-kube-api-access-bvgz8\") pod \"auth-test-model-b37684-kserve-d98cf4f7c-5trht\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") " pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:04.029200 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:04.029114    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:04.407057 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:04.407016    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"]
Oct 30 20:24:04.412415 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:24:04.412384    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e0c9a0d_1cf6_4a40_9591_81e467234036.slice/crio-76f91835d32352a956fd05c64a2f0cd79d2b1ef1bebca041f22f69140b985a7a WatchSource:0}: Error finding container 76f91835d32352a956fd05c64a2f0cd79d2b1ef1bebca041f22f69140b985a7a: Status 404 returned error can't find the container with id 76f91835d32352a956fd05c64a2f0cd79d2b1ef1bebca041f22f69140b985a7a
Oct 30 20:24:04.763858 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:04.763745    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht" event={"ID":"3e0c9a0d-1cf6-4a40-9591-81e467234036","Type":"ContainerStarted","Data":"68b6054bed0a644965095f797cc62256ec3eb45293326b060fb69f3e912214c8"}
Oct 30 20:24:04.763858 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:04.763799    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht" event={"ID":"3e0c9a0d-1cf6-4a40-9591-81e467234036","Type":"ContainerStarted","Data":"76f91835d32352a956fd05c64a2f0cd79d2b1ef1bebca041f22f69140b985a7a"}
Oct 30 20:24:04.876956 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:04.876901    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht" podStartSLOduration=1.8768837710000001 podStartE2EDuration="1.876883771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:24:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:24:04.876002172 +0000 UTC m=+3507.418809439" watchObservedRunningTime="2026-10-30 20:24:04.876883771 +0000 UTC m=+3507.419691074"
Oct 30 20:24:05.029894 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:05.029787    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:07.777084 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:07.777048    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:12.351750 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:12.351698    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:13.361121 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:13.361078    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:14.029869 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:14.029791    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:14.042671 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:14.042643    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:14.839930 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:14.839897    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:24:16.970800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:16.970697    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:17.022874 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.022799    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w" podUID="1c85b66c-066c-4742-8217-05f528fc2d7b" containerName="main" containerID="cri-o://9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab" gracePeriod=45
Oct 30 20:24:17.311978 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.311948    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:24:17.375788 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.375749    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-home\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-home\") pod \"1c85b66c-066c-4742-8217-05f528fc2d7b\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") "
Oct 30 20:24:17.376029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.375801    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-dshm\") pod \"1c85b66c-066c-4742-8217-05f528fc2d7b\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") "
Oct 30 20:24:17.376029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.375876    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1c85b66c-066c-4742-8217-05f528fc2d7b-tls-certs\" (UniqueName: \"kubernetes.io/secret/1c85b66c-066c-4742-8217-05f528fc2d7b-tls-certs\") pod \"1c85b66c-066c-4742-8217-05f528fc2d7b\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") "
Oct 30 20:24:17.376029 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.376023    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-tmp-dir\") pod \"1c85b66c-066c-4742-8217-05f528fc2d7b\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") "
Oct 30 20:24:17.376160 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.376078    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-model-cache\") pod \"1c85b66c-066c-4742-8217-05f528fc2d7b\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") "
Oct 30 20:24:17.376160 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.376088    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-home" pod "1c85b66c-066c-4742-8217-05f528fc2d7b" (UID: "1c85b66c-066c-4742-8217-05f528fc2d7b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:24:17.376160 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.376137    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c85b66c-066c-4742-8217-05f528fc2d7b-kube-api-access-74jrr\" (UniqueName: \"kubernetes.io/projected/1c85b66c-066c-4742-8217-05f528fc2d7b-kube-api-access-74jrr\") pod \"1c85b66c-066c-4742-8217-05f528fc2d7b\" (UID: \"1c85b66c-066c-4742-8217-05f528fc2d7b\") "
Oct 30 20:24:17.376406 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.376372    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-tmp-dir" pod "1c85b66c-066c-4742-8217-05f528fc2d7b" (UID: "1c85b66c-066c-4742-8217-05f528fc2d7b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:24:17.376492 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.376410    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-model-cache" pod "1c85b66c-066c-4742-8217-05f528fc2d7b" (UID: "1c85b66c-066c-4742-8217-05f528fc2d7b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:24:17.376846 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.376790    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:24:17.376967 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.376850    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:24:17.376967 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.376866    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:24:17.378785 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.378755    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c85b66c-066c-4742-8217-05f528fc2d7b-kube-api-access-74jrr" pod "1c85b66c-066c-4742-8217-05f528fc2d7b" (UID: "1c85b66c-066c-4742-8217-05f528fc2d7b"). InnerVolumeSpecName "kube-api-access-74jrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:24:17.379033 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.379004    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c85b66c-066c-4742-8217-05f528fc2d7b-tls-certs" pod "1c85b66c-066c-4742-8217-05f528fc2d7b" (UID: "1c85b66c-066c-4742-8217-05f528fc2d7b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:24:17.379033 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.379004    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-dshm" pod "1c85b66c-066c-4742-8217-05f528fc2d7b" (UID: "1c85b66c-066c-4742-8217-05f528fc2d7b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:24:17.478667 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.478622    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c85b66c-066c-4742-8217-05f528fc2d7b-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:24:17.478667 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.478669    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c85b66c-066c-4742-8217-05f528fc2d7b-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:24:17.478921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.478686    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74jrr\" (UniqueName: \"kubernetes.io/projected/1c85b66c-066c-4742-8217-05f528fc2d7b-kube-api-access-74jrr\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:24:17.849242 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.849207    6015 generic.go:356] "Generic (PLEG): container finished" podID="1c85b66c-066c-4742-8217-05f528fc2d7b" containerID="9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab" exitCode=0
Oct 30 20:24:17.849445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.849253    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"
Oct 30 20:24:17.849445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.849263    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w" event={"ID":"1c85b66c-066c-4742-8217-05f528fc2d7b","Type":"ContainerDied","Data":"9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab"}
Oct 30 20:24:17.849445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.849294    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w" event={"ID":"1c85b66c-066c-4742-8217-05f528fc2d7b","Type":"ContainerDied","Data":"2671d2d849962efd7337e14407667dc03570dd7441c975bc8e9891521eb304f3"}
Oct 30 20:24:17.849445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.849310    6015 scope.go:122] "RemoveContainer" containerID="9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab"
Oct 30 20:24:17.861993 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.861672    6015 scope.go:122] "RemoveContainer" containerID="9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab"
Oct 30 20:24:17.862340 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:24:17.862316    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab\": container with ID starting with 9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab not found: ID does not exist" containerID="9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab"
Oct 30 20:24:17.862422 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:17.862351    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab"} err="failed to get container status \"9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab\": rpc error: code = NotFound desc = could not find container \"9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab\": container with ID starting with 9dfa8ae907a310f3564035f5f486f8e5c98be63dce90867d8f0ca4a9274b13ab not found: ID does not exist"
Oct 30 20:24:18.010554 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:18.010514    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"]
Oct 30 20:24:18.057005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:18.056967    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-4b0bf3/explicit-model-4b0bf3-kserve-8469d8c497-8vn5w"]
Oct 30 20:24:19.589188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:19.589146    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1c85b66c-066c-4742-8217-05f528fc2d7b" path="/var/lib/kubelet/pods/1c85b66c-066c-4742-8217-05f528fc2d7b/volumes"
Oct 30 20:24:21.046618 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:21.046583    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:22.495543 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:22.495500    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:22.763089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:22.762990    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:22.945703 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:22.945666    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:23.500415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:23.500374    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:27.562523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:27.562477    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:28.217988 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:24:28.217953    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:24:30.248431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:30.248395    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:30.460675 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:30.460630    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:30.623687 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:30.623650    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:31.247377 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.247334    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:31.864096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.864061    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"]
Oct 30 20:24:31.892325 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.892292    6015 cpu_manager.go:414] "containerMap: removing container" podUID="1c85b66c-066c-4742-8217-05f528fc2d7b" containerName="main"
Oct 30 20:24:31.892325 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.892322    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1c85b66c-066c-4742-8217-05f528fc2d7b" containerName="main"
Oct 30 20:24:31.892631 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.892598    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="1c85b66c-066c-4742-8217-05f528fc2d7b" containerName="main"
Oct 30 20:24:31.912628 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.912598    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:31.914137 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.914117    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:31.925054 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.925020    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"]
Oct 30 20:24:31.969307 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.969272    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-bd4c7f-openshift-default-dockercfg-2bm5c\""
Oct 30 20:24:31.994899 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.994864    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-istio-token\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:31.994899 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.994911    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950328e9-edfb-41fa-beba-7e31ac311820-istio-podinfo\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:31.995190 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.994938    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ghqw\" (UniqueName: \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-kube-api-access-4ghqw\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:31.995190 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.995142    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-certs\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:31.995294 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.995245    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-data\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:31.995294 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.995278    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-envoy\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:31.995403 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.995385    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950328e9-edfb-41fa-beba-7e31ac311820-istiod-ca-cert\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:31.995461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.995431    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-socket\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:31.995567 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:31.995551    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-credential-socket\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.096851 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.096762    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-credential-socket\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097061 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.096882    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-istio-token\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097061 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.096924    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950328e9-edfb-41fa-beba-7e31ac311820-istio-podinfo\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097061 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.096957    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ghqw\" (UniqueName: \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-kube-api-access-4ghqw\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097061 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.097053    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-certs\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097323 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.097124    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-data\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097323 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.097159    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-envoy\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097323 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.097233    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-credential-socket\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097503 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.097325    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950328e9-edfb-41fa-beba-7e31ac311820-istiod-ca-cert\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097503 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.097389    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-socket\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097503 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.097407    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-data\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.097546    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-certs\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.097739 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.097718    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-socket\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.098154 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.098123    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950328e9-edfb-41fa-beba-7e31ac311820-istiod-ca-cert\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.099587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.099557    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-envoy\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.099945 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.099923    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950328e9-edfb-41fa-beba-7e31ac311820-istio-podinfo\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.156321 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.156240    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ghqw\" (UniqueName: \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-kube-api-access-4ghqw\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.156505 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.156483    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-istio-token\") pod \"e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") " pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.183388 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.183328    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:32.232197 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.232166    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:32.376793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.376753    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:32.663470 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.663433    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"]
Oct 30 20:24:32.668419 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:24:32.668374    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950328e9_edfb_41fa_beba_7e31ac311820.slice/crio-afcfcdddf1928013f308fd2a5588df45860b3f51fba3d337ba12b995612166e6 WatchSource:0}: Error finding container afcfcdddf1928013f308fd2a5588df45860b3f51fba3d337ba12b995612166e6: Status 404 returned error can't find the container with id afcfcdddf1928013f308fd2a5588df45860b3f51fba3d337ba12b995612166e6
Oct 30 20:24:32.670796 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.670761    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:24:32.670909 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.670875    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:24:32.670951 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.670908    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:24:32.953583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.953485    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7" event={"ID":"950328e9-edfb-41fa-beba-7e31ac311820","Type":"ContainerStarted","Data":"b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6"}
Oct 30 20:24:32.953583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:32.953546    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7" event={"ID":"950328e9-edfb-41fa-beba-7e31ac311820","Type":"ContainerStarted","Data":"afcfcdddf1928013f308fd2a5588df45860b3f51fba3d337ba12b995612166e6"}
Oct 30 20:24:33.070017 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:33.069961    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7" podStartSLOduration=2.06994567 podStartE2EDuration="2.06994567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:24:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:24:33.068738322 +0000 UTC m=+3535.611545589" watchObservedRunningTime="2026-10-30 20:24:33.06994567 +0000 UTC m=+3535.612752932"
Oct 30 20:24:33.233384 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:33.233296    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:33.239692 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:33.239662    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:33.476792 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:33.476753    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:33.629554 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:33.629515    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:33.785278 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:33.785239    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:33.960090 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:33.960008    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:33.960901 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:33.960871    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:24:36.779960 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:36.779919    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:41.515981 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:41.515943    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:45.407770 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:45.407720    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:45.570532 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:45.570482    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:46.019415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:46.019354    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:46.178043 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:46.178003    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:50.552645 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:50.552612    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:55.093910 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:55.093864    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:58.216993 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:24:58.216953    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:24:59.159627 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:59.159592    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:24:59.681993 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:24:59.681947    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:04.247121 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:04.247086    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:08.801658 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:08.801615    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:13.451451 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:13.451389    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:18.082419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:18.082380    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:22.629070 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:22.629020    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:27.132756 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:27.132719    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:27.300863 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:27.300821    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:28.217294 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:25:28.217250    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:25:31.853143 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:31.853103    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:36.455446 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:36.455400    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:41.054710 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:41.054671    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:45.576570 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:45.576507    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:49.906094 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:49.906054    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:50.071622 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:50.071582    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:50.289085 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:50.288988    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:51.935525 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:51.935480    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:52.103202 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:52.103170    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"]
Oct 30 20:25:52.103485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:52.103457    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7" podUID="950328e9-edfb-41fa-beba-7e31ac311820" containerName="istio-proxy" containerID="cri-o://b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6" gracePeriod=30
Oct 30 20:25:52.162954 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:52.162895    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:52.432585 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:52.432545    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:52.591012 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:52.590972    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:54.861515 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:54.861473    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:57.117185 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:25:57.117155    6015 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950328e9_edfb_41fa_beba_7e31ac311820.slice/crio-b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 20:25:57.377760 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.377680    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:25:57.436007 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.435965    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-socket\") pod \"950328e9-edfb-41fa-beba-7e31ac311820\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") "
Oct 30 20:25:57.436194 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436019    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-envoy\") pod \"950328e9-edfb-41fa-beba-7e31ac311820\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") "
Oct 30 20:25:57.436194 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436149    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-credential-socket\") pod \"950328e9-edfb-41fa-beba-7e31ac311820\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") "
Oct 30 20:25:57.436332 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436212    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/950328e9-edfb-41fa-beba-7e31ac311820-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950328e9-edfb-41fa-beba-7e31ac311820-istiod-ca-cert\") pod \"950328e9-edfb-41fa-beba-7e31ac311820\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") "
Oct 30 20:25:57.436332 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436277    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-data\") pod \"950328e9-edfb-41fa-beba-7e31ac311820\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") "
Oct 30 20:25:57.436332 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436281    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-socket" pod "950328e9-edfb-41fa-beba-7e31ac311820" (UID: "950328e9-edfb-41fa-beba-7e31ac311820"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:25:57.436332 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436327    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-certs\") pod \"950328e9-edfb-41fa-beba-7e31ac311820\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") "
Oct 30 20:25:57.436547 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436354    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/950328e9-edfb-41fa-beba-7e31ac311820-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950328e9-edfb-41fa-beba-7e31ac311820-istio-podinfo\") pod \"950328e9-edfb-41fa-beba-7e31ac311820\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") "
Oct 30 20:25:57.436547 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436420    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-istio-token\" (UniqueName: \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-istio-token\") pod \"950328e9-edfb-41fa-beba-7e31ac311820\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") "
Oct 30 20:25:57.436547 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436462    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-kube-api-access-4ghqw\" (UniqueName: \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-kube-api-access-4ghqw\") pod \"950328e9-edfb-41fa-beba-7e31ac311820\" (UID: \"950328e9-edfb-41fa-beba-7e31ac311820\") "
Oct 30 20:25:57.436547 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436466    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-credential-socket" pod "950328e9-edfb-41fa-beba-7e31ac311820" (UID: "950328e9-edfb-41fa-beba-7e31ac311820"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:25:57.436752 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436552    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-data" pod "950328e9-edfb-41fa-beba-7e31ac311820" (UID: "950328e9-edfb-41fa-beba-7e31ac311820"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:25:57.436752 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436594    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-certs" pod "950328e9-edfb-41fa-beba-7e31ac311820" (UID: "950328e9-edfb-41fa-beba-7e31ac311820"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:25:57.436752 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.436620    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/950328e9-edfb-41fa-beba-7e31ac311820-istiod-ca-cert" pod "950328e9-edfb-41fa-beba-7e31ac311820" (UID: "950328e9-edfb-41fa-beba-7e31ac311820"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:25:57.437141 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.437050    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:25:57.437272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.437225    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:25:57.437272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.437250    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950328e9-edfb-41fa-beba-7e31ac311820-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:25:57.437272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.437265    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:25:57.437459 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.437277    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:25:57.438692 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.438666    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-envoy" pod "950328e9-edfb-41fa-beba-7e31ac311820" (UID: "950328e9-edfb-41fa-beba-7e31ac311820"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:25:57.438825 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.438771    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-istio-token" pod "950328e9-edfb-41fa-beba-7e31ac311820" (UID: "950328e9-edfb-41fa-beba-7e31ac311820"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:25:57.439153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.439131    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/950328e9-edfb-41fa-beba-7e31ac311820-istio-podinfo" pod "950328e9-edfb-41fa-beba-7e31ac311820" (UID: "950328e9-edfb-41fa-beba-7e31ac311820"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:25:57.439243 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.439203    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-kube-api-access-4ghqw" pod "950328e9-edfb-41fa-beba-7e31ac311820" (UID: "950328e9-edfb-41fa-beba-7e31ac311820"). InnerVolumeSpecName "kube-api-access-4ghqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:25:57.514680 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.514640    6015 generic.go:356] "Generic (PLEG): container finished" podID="950328e9-edfb-41fa-beba-7e31ac311820" containerID="b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6" exitCode=0
Oct 30 20:25:57.514934 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.514758    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"
Oct 30 20:25:57.514934 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.514778    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7" event={"ID":"950328e9-edfb-41fa-beba-7e31ac311820","Type":"ContainerDied","Data":"b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6"}
Oct 30 20:25:57.514934 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.514852    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7" event={"ID":"950328e9-edfb-41fa-beba-7e31ac311820","Type":"ContainerDied","Data":"afcfcdddf1928013f308fd2a5588df45860b3f51fba3d337ba12b995612166e6"}
Oct 30 20:25:57.514934 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.514877    6015 scope.go:122] "RemoveContainer" containerID="b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6"
Oct 30 20:25:57.526203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.526174    6015 scope.go:122] "RemoveContainer" containerID="b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6"
Oct 30 20:25:57.526517 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:25:57.526497    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6\": container with ID starting with b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6 not found: ID does not exist" containerID="b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6"
Oct 30 20:25:57.526587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.526526    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6"} err="failed to get container status \"b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6\": rpc error: code = NotFound desc = could not find container \"b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6\": container with ID starting with b2ff9bbffedbb62d1e781b848eb5c5ce01cbabf5264f57c422e10c4251cb23c6 not found: ID does not exist"
Oct 30 20:25:57.539238 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.539180    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950328e9-edfb-41fa-beba-7e31ac311820-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:25:57.539238 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.539239    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:25:57.539441 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.539256    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ghqw\" (UniqueName: \"kubernetes.io/projected/950328e9-edfb-41fa-beba-7e31ac311820-kube-api-access-4ghqw\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:25:57.539441 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.539272    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950328e9-edfb-41fa-beba-7e31ac311820-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:25:57.672711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.668637    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"]
Oct 30 20:25:57.672711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.672555    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-bd4c7f-openshift-default-c966fdcb9-vw4r7"]
Oct 30 20:25:57.719257 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:57.719214    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:58.218675 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:25:58.218635    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:25:59.513964 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:59.513922    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:25:59.589020 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:59.588979    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="950328e9-edfb-41fa-beba-7e31ac311820" path="/var/lib/kubelet/pods/950328e9-edfb-41fa-beba-7e31ac311820/volumes"
Oct 30 20:25:59.721345 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:25:59.721303    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:04.327752 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:04.327709    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:08.936528 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:08.936489    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:13.548224 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:13.548185    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:18.196547 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:18.196504    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:22.774006 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:22.773966    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:27.476125 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:27.476088    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:28.219979 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:26:28.219930    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:26:32.096986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:32.096946    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:35.609228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:35.609185    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:36.757718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:36.757676    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:39.849202 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:39.849167    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:40.467825 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:40.467772    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:40.701058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:40.701016    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:41.562444 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:41.562407    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:44.303412 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:44.303375    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:44.497319 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:44.497282    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:44.810075 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:44.810030    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:46.513984 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:46.513950    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:47.612820 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:47.612762    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:47.799635 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:47.799592    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:48.026130 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.026044    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"]
Oct 30 20:26:48.026687 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.026672    6015 cpu_manager.go:414] "containerMap: removing container" podUID="950328e9-edfb-41fa-beba-7e31ac311820" containerName="istio-proxy"
Oct 30 20:26:48.026749 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.026689    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="950328e9-edfb-41fa-beba-7e31ac311820" containerName="istio-proxy"
Oct 30 20:26:48.026897 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.026883    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="950328e9-edfb-41fa-beba-7e31ac311820" containerName="istio-proxy"
Oct 30 20:26:48.031609 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.031587    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:26:48.128831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.125197    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5bwf\" (UniqueName: \"kubernetes.io/projected/013f02fc-ceea-4ecd-a959-8ff18321bffb-kube-api-access-q5bwf\") pod \"payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6\" (UID: \"013f02fc-ceea-4ecd-a959-8ff18321bffb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:26:48.128831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.125372    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/013f02fc-ceea-4ecd-a959-8ff18321bffb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6\" (UID: \"013f02fc-ceea-4ecd-a959-8ff18321bffb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:26:48.128831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.127661    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w4-742ff8-dockercfg-ps6lw\""
Oct 30 20:26:48.128831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.127847    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w4-742ff8\""
Oct 30 20:26:48.133330 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.133301    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"]
Oct 30 20:26:48.178239 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.178191    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"]
Oct 30 20:26:48.182978 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.182953    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:26:48.224550 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.224500    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"]
Oct 30 20:26:48.227095 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.227064    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5bwf\" (UniqueName: \"kubernetes.io/projected/013f02fc-ceea-4ecd-a959-8ff18321bffb-kube-api-access-q5bwf\") pod \"payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6\" (UID: \"013f02fc-ceea-4ecd-a959-8ff18321bffb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:26:48.227270 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.227129    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/013f02fc-ceea-4ecd-a959-8ff18321bffb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6\" (UID: \"013f02fc-ceea-4ecd-a959-8ff18321bffb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:26:48.227931 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.227905    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/013f02fc-ceea-4ecd-a959-8ff18321bffb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6\" (UID: \"013f02fc-ceea-4ecd-a959-8ff18321bffb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:26:48.285742 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.285671    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5bwf\" (UniqueName: \"kubernetes.io/projected/013f02fc-ceea-4ecd-a959-8ff18321bffb-kube-api-access-q5bwf\") pod \"payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6\" (UID: \"013f02fc-ceea-4ecd-a959-8ff18321bffb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:26:48.328896 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.328841    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmqzr\" (UniqueName: \"kubernetes.io/projected/5ff2e779-97b8-4c85-8883-0a643fbcc30d-kube-api-access-kmqzr\") pod \"payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr\" (UID: \"5ff2e779-97b8-4c85-8883-0a643fbcc30d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:26:48.329142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.329119    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ff2e779-97b8-4c85-8883-0a643fbcc30d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr\" (UID: \"5ff2e779-97b8-4c85-8883-0a643fbcc30d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:26:48.345550 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.345508    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:26:48.430360 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.430333    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ff2e779-97b8-4c85-8883-0a643fbcc30d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr\" (UID: \"5ff2e779-97b8-4c85-8883-0a643fbcc30d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:26:48.430546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.430399    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmqzr\" (UniqueName: \"kubernetes.io/projected/5ff2e779-97b8-4c85-8883-0a643fbcc30d-kube-api-access-kmqzr\") pod \"payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr\" (UID: \"5ff2e779-97b8-4c85-8883-0a643fbcc30d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:26:48.431110 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.431087    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ff2e779-97b8-4c85-8883-0a643fbcc30d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr\" (UID: \"5ff2e779-97b8-4c85-8883-0a643fbcc30d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:26:48.489211 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.489175    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmqzr\" (UniqueName: \"kubernetes.io/projected/5ff2e779-97b8-4c85-8883-0a643fbcc30d-kube-api-access-kmqzr\") pod \"payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr\" (UID: \"5ff2e779-97b8-4c85-8883-0a643fbcc30d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:26:48.497464 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.497435    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:26:48.723993 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.723959    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"]
Oct 30 20:26:48.730204 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:26:48.730170    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod013f02fc_ceea_4ecd_a959_8ff18321bffb.slice/crio-955dc4ee324c4fa7684561079ab8f544537d247f3a8f4e5d5e0756faf1400382 WatchSource:0}: Error finding container 955dc4ee324c4fa7684561079ab8f544537d247f3a8f4e5d5e0756faf1400382: Status 404 returned error can't find the container with id 955dc4ee324c4fa7684561079ab8f544537d247f3a8f4e5d5e0756faf1400382
Oct 30 20:26:48.868310 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.868207    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6" event={"ID":"013f02fc-ceea-4ecd-a959-8ff18321bffb","Type":"ContainerStarted","Data":"eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff"}
Oct 30 20:26:48.868310 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.868276    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6" event={"ID":"013f02fc-ceea-4ecd-a959-8ff18321bffb","Type":"ContainerStarted","Data":"955dc4ee324c4fa7684561079ab8f544537d247f3a8f4e5d5e0756faf1400382"}
Oct 30 20:26:48.868551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.868318    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:26:48.880989 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.880955    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"]
Oct 30 20:26:48.887931 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:26:48.887892    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff2e779_97b8_4c85_8883_0a643fbcc30d.slice/crio-d9369fceedf185faa3d1e07ab932336880b43285935b32a32c59411677927fda WatchSource:0}: Error finding container d9369fceedf185faa3d1e07ab932336880b43285935b32a32c59411677927fda: Status 404 returned error can't find the container with id d9369fceedf185faa3d1e07ab932336880b43285935b32a32c59411677927fda
Oct 30 20:26:48.983870 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:48.983767    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6" podStartSLOduration=1.983753535 podStartE2EDuration="1.983753535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:26:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:48.982391678 +0000 UTC m=+3671.525198942" watchObservedRunningTime="2026-10-30 20:26:48.983753535 +0000 UTC m=+3671.526560801"
Oct 30 20:26:49.875663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:49.875616    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr" event={"ID":"5ff2e779-97b8-4c85-8883-0a643fbcc30d","Type":"ContainerStarted","Data":"e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e"}
Oct 30 20:26:49.876165 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:49.875690    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr" event={"ID":"5ff2e779-97b8-4c85-8883-0a643fbcc30d","Type":"ContainerStarted","Data":"d9369fceedf185faa3d1e07ab932336880b43285935b32a32c59411677927fda"}
Oct 30 20:26:49.876165 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:49.876036    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:26:49.986378 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:49.986315    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr" podStartSLOduration=1.986298444 podStartE2EDuration="1.986298444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:26:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:26:49.985538583 +0000 UTC m=+3672.528345873" watchObservedRunningTime="2026-10-30 20:26:49.986298444 +0000 UTC m=+3672.529105700"
Oct 30 20:26:51.178113 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:51.178083    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:51.450929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:51.450796    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:55.765675 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:55.765638    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:58.216978 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:26:58.216937    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:26:59.871487 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:59.871444    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:26:59.879284 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:26:59.879256    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:27:00.373964 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:00.373922    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:00.887050 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:00.887013    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:27:05.069769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:05.069711    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:09.711680 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:09.711639    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:14.355682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:14.355641    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:18.958160 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:18.958078    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:23.546855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:23.546796    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:28.107631 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:28.107574    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:28.216322 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:27:28.216283    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:27:32.795312 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:32.795268    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:37.391454 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:37.391419    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:39.083475 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:39.083439    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:41.975955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:41.975924    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:46.539799 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:46.539758    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:50.999392 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:50.999352    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:51.198114 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:51.198064    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:51.359894 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:51.359847    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:55.422201 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:55.422168    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"]
Oct 30 20:27:55.501026 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:55.500990    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:55.770999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:27:55.770903    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:27:58.217801 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:27:58.217756    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:28:00.218959 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:00.218925    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:00.396133 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:00.396089    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:05.040502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:05.040442    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:09.284860 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:09.284786    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:09.721419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:09.721385    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:09.984475 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:09.984383    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:10.219277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.219242    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:10.444065 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.444017    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79" podUID="44b155e6-0d06-49d8-8fc3-15026299710d" containerName="main" containerID="cri-o://464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93" gracePeriod=45
Oct 30 20:28:10.494196 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.494154    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:10.719470 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.719132    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:28:10.838334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.838297    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-tmp-dir\") pod \"44b155e6-0d06-49d8-8fc3-15026299710d\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") "
Oct 30 20:28:10.838528 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.838402    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-dshm\") pod \"44b155e6-0d06-49d8-8fc3-15026299710d\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") "
Oct 30 20:28:10.838528 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.838450    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/44b155e6-0d06-49d8-8fc3-15026299710d-tls-certs\" (UniqueName: \"kubernetes.io/secret/44b155e6-0d06-49d8-8fc3-15026299710d-tls-certs\") pod \"44b155e6-0d06-49d8-8fc3-15026299710d\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") "
Oct 30 20:28:10.838662 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.838602    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-home\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-home\") pod \"44b155e6-0d06-49d8-8fc3-15026299710d\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") "
Oct 30 20:28:10.838662 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.838610    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-tmp-dir" pod "44b155e6-0d06-49d8-8fc3-15026299710d" (UID: "44b155e6-0d06-49d8-8fc3-15026299710d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:28:10.838662 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.838638    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44b155e6-0d06-49d8-8fc3-15026299710d-kube-api-access-gts5s\" (UniqueName: \"kubernetes.io/projected/44b155e6-0d06-49d8-8fc3-15026299710d-kube-api-access-gts5s\") pod \"44b155e6-0d06-49d8-8fc3-15026299710d\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") "
Oct 30 20:28:10.838849 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.838751    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-model-cache\") pod \"44b155e6-0d06-49d8-8fc3-15026299710d\" (UID: \"44b155e6-0d06-49d8-8fc3-15026299710d\") "
Oct 30 20:28:10.838915 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.838844    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-home" pod "44b155e6-0d06-49d8-8fc3-15026299710d" (UID: "44b155e6-0d06-49d8-8fc3-15026299710d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:28:10.839132 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.839109    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-model-cache" pod "44b155e6-0d06-49d8-8fc3-15026299710d" (UID: "44b155e6-0d06-49d8-8fc3-15026299710d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:28:10.839450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.839335    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:28:10.839450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.839372    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:28:10.839450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.839390    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:28:10.841448 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.841263    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-dshm" pod "44b155e6-0d06-49d8-8fc3-15026299710d" (UID: "44b155e6-0d06-49d8-8fc3-15026299710d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:28:10.841715 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.841692    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44b155e6-0d06-49d8-8fc3-15026299710d-kube-api-access-gts5s" pod "44b155e6-0d06-49d8-8fc3-15026299710d" (UID: "44b155e6-0d06-49d8-8fc3-15026299710d"). InnerVolumeSpecName "kube-api-access-gts5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:28:10.841834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.841731    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b155e6-0d06-49d8-8fc3-15026299710d-tls-certs" pod "44b155e6-0d06-49d8-8fc3-15026299710d" (UID: "44b155e6-0d06-49d8-8fc3-15026299710d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:28:10.942860 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.941913    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b155e6-0d06-49d8-8fc3-15026299710d-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:28:10.942860 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.941953    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b155e6-0d06-49d8-8fc3-15026299710d-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:28:10.942860 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:10.941969    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gts5s\" (UniqueName: \"kubernetes.io/projected/44b155e6-0d06-49d8-8fc3-15026299710d-kube-api-access-gts5s\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:28:11.440602 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:11.440570    6015 generic.go:356] "Generic (PLEG): container finished" podID="44b155e6-0d06-49d8-8fc3-15026299710d" containerID="464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93" exitCode=0
Oct 30 20:28:11.440801 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:11.440632    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"
Oct 30 20:28:11.440801 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:11.440653    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79" event={"ID":"44b155e6-0d06-49d8-8fc3-15026299710d","Type":"ContainerDied","Data":"464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93"}
Oct 30 20:28:11.440801 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:11.440698    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79" event={"ID":"44b155e6-0d06-49d8-8fc3-15026299710d","Type":"ContainerDied","Data":"adbe3b8f59bd69d80a37357a8ce571e1b916b52d7a3b60682519395fe09b2d14"}
Oct 30 20:28:11.440801 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:11.440715    6015 scope.go:122] "RemoveContainer" containerID="464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93"
Oct 30 20:28:11.452442 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:11.452313    6015 scope.go:122] "RemoveContainer" containerID="464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93"
Oct 30 20:28:11.452738 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:28:11.452663    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93\": container with ID starting with 464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93 not found: ID does not exist" containerID="464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93"
Oct 30 20:28:11.452738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:11.452693    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93"} err="failed to get container status \"464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93\": rpc error: code = NotFound desc = could not find container \"464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93\": container with ID starting with 464c43760a1f82c53deb4a46e6898ae0cc2e13bae33cfa4fda19892e433efc93 not found: ID does not exist"
Oct 30 20:28:11.598551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:11.598515    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"]
Oct 30 20:28:11.645103 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:11.645070    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w0-e4864d/auth-test-model-e4864d-kserve-779b8c449c-6td79"]
Oct 30 20:28:13.590243 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:13.590194    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="44b155e6-0d06-49d8-8fc3-15026299710d" path="/var/lib/kubelet/pods/44b155e6-0d06-49d8-8fc3-15026299710d/volumes"
Oct 30 20:28:13.831415 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:13.831375    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:14.045146 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:14.045110    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:14.491748 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:14.491658    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:17.098973 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.098933    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:17.274276 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.274235    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:17.498369 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.498269    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"]
Oct 30 20:28:17.499112 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.499088    6015 cpu_manager.go:414] "containerMap: removing container" podUID="44b155e6-0d06-49d8-8fc3-15026299710d" containerName="main"
Oct 30 20:28:17.499112 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.499112    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44b155e6-0d06-49d8-8fc3-15026299710d" containerName="main"
Oct 30 20:28:17.499324 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.499263    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="44b155e6-0d06-49d8-8fc3-15026299710d" containerName="main"
Oct 30 20:28:17.503740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.503716    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:28:17.600378 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.600347    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-a-0e72bd\""
Oct 30 20:28:17.600685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.600667    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-a-0e72bd-dockercfg-m74kq\""
Oct 30 20:28:17.609545 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.609512    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"]
Oct 30 20:28:17.657193 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.657151    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"]
Oct 30 20:28:17.660702 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.660666    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm9mj\" (UniqueName: \"kubernetes.io/projected/2b05030d-6dbd-4f36-9304-cf5cd028b99d-kube-api-access-dm9mj\") pod \"payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn\" (UID: \"2b05030d-6dbd-4f36-9304-cf5cd028b99d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:28:17.668951 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.668918    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b05030d-6dbd-4f36-9304-cf5cd028b99d-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn\" (UID: \"2b05030d-6dbd-4f36-9304-cf5cd028b99d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:28:17.669288 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.666995    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:28:17.705713 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.705676    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"]
Oct 30 20:28:17.771014 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.770911    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4zg6\" (UniqueName: \"kubernetes.io/projected/da1ce8df-cc26-42d7-a76d-b5d63110521a-kube-api-access-z4zg6\") pod \"payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6\" (UID: \"da1ce8df-cc26-42d7-a76d-b5d63110521a\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:28:17.771206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.771045    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da1ce8df-cc26-42d7-a76d-b5d63110521a-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6\" (UID: \"da1ce8df-cc26-42d7-a76d-b5d63110521a\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:28:17.771206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.771109    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm9mj\" (UniqueName: \"kubernetes.io/projected/2b05030d-6dbd-4f36-9304-cf5cd028b99d-kube-api-access-dm9mj\") pod \"payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn\" (UID: \"2b05030d-6dbd-4f36-9304-cf5cd028b99d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:28:17.771206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.771143    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b05030d-6dbd-4f36-9304-cf5cd028b99d-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn\" (UID: \"2b05030d-6dbd-4f36-9304-cf5cd028b99d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:28:17.771985 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.771963    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b05030d-6dbd-4f36-9304-cf5cd028b99d-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn\" (UID: \"2b05030d-6dbd-4f36-9304-cf5cd028b99d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:28:17.829905 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.829865    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm9mj\" (UniqueName: \"kubernetes.io/projected/2b05030d-6dbd-4f36-9304-cf5cd028b99d-kube-api-access-dm9mj\") pod \"payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn\" (UID: \"2b05030d-6dbd-4f36-9304-cf5cd028b99d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:28:17.872634 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.872593    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da1ce8df-cc26-42d7-a76d-b5d63110521a-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6\" (UID: \"da1ce8df-cc26-42d7-a76d-b5d63110521a\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:28:17.872887 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.872866    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4zg6\" (UniqueName: \"kubernetes.io/projected/da1ce8df-cc26-42d7-a76d-b5d63110521a-kube-api-access-z4zg6\") pod \"payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6\" (UID: \"da1ce8df-cc26-42d7-a76d-b5d63110521a\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:28:17.873424 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.873402    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da1ce8df-cc26-42d7-a76d-b5d63110521a-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6\" (UID: \"da1ce8df-cc26-42d7-a76d-b5d63110521a\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:28:17.931351 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.931317    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4zg6\" (UniqueName: \"kubernetes.io/projected/da1ce8df-cc26-42d7-a76d-b5d63110521a-kube-api-access-z4zg6\") pod \"payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6\" (UID: \"da1ce8df-cc26-42d7-a76d-b5d63110521a\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:28:17.987683 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:17.987630    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:28:18.119934 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:18.119894    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:28:18.368587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:18.368501    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"]
Oct 30 20:28:18.374410 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:28:18.374373    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1ce8df_cc26_42d7_a76d_b5d63110521a.slice/crio-abee8c37bf10c0201d7406ac4f0bd341159e4ec42d19a077ff8d9880f1eaf5ea WatchSource:0}: Error finding container abee8c37bf10c0201d7406ac4f0bd341159e4ec42d19a077ff8d9880f1eaf5ea: Status 404 returned error can't find the container with id abee8c37bf10c0201d7406ac4f0bd341159e4ec42d19a077ff8d9880f1eaf5ea
Oct 30 20:28:18.492464 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:18.492423    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6" event={"ID":"da1ce8df-cc26-42d7-a76d-b5d63110521a","Type":"ContainerStarted","Data":"eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b"}
Oct 30 20:28:18.492686 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:18.492488    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6" event={"ID":"da1ce8df-cc26-42d7-a76d-b5d63110521a","Type":"ContainerStarted","Data":"abee8c37bf10c0201d7406ac4f0bd341159e4ec42d19a077ff8d9880f1eaf5ea"}
Oct 30 20:28:18.492686 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:18.492620    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:28:18.499021 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:18.498985    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"]
Oct 30 20:28:18.503995 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:28:18.503964    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b05030d_6dbd_4f36_9304_cf5cd028b99d.slice/crio-d86683383ec009d3050b7e9fe1736fdfc98a17d663962fad4d841aad3deae9f4 WatchSource:0}: Error finding container d86683383ec009d3050b7e9fe1736fdfc98a17d663962fad4d841aad3deae9f4: Status 404 returned error can't find the container with id d86683383ec009d3050b7e9fe1736fdfc98a17d663962fad4d841aad3deae9f4
Oct 30 20:28:18.608643 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:18.608576    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6" podStartSLOduration=1.608556372 podStartE2EDuration="1.608556372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:28:18.604144444 +0000 UTC m=+3761.146951700" watchObservedRunningTime="2026-10-30 20:28:18.608556372 +0000 UTC m=+3761.151363638"
Oct 30 20:28:19.501718 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:19.501677    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn" event={"ID":"2b05030d-6dbd-4f36-9304-cf5cd028b99d","Type":"ContainerStarted","Data":"dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247"}
Oct 30 20:28:19.502206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:19.501743    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn" event={"ID":"2b05030d-6dbd-4f36-9304-cf5cd028b99d","Type":"ContainerStarted","Data":"d86683383ec009d3050b7e9fe1736fdfc98a17d663962fad4d841aad3deae9f4"}
Oct 30 20:28:19.628631 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:19.628561    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn" podStartSLOduration=2.628542317 podStartE2EDuration="2.628542317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:28:19.628107483 +0000 UTC m=+3762.170914749" watchObservedRunningTime="2026-10-30 20:28:19.628542317 +0000 UTC m=+3762.171349583"
Oct 30 20:28:19.798722 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:19.798684    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:19.958306 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:19.958266    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:20.510901 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:20.510865    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:28:24.444086 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:24.444049    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:28.216699 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:28:28.216660    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:28:28.972004 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:28.971973    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:29.505821 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:29.505773    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:28:31.521914 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:31.521880    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:28:33.509186 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:33.509144    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:38.070657 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:38.070618    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:41.425603 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:41.425565    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:42.671378 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:42.671343    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:46.137154 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:46.137061    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"]
Oct 30 20:28:46.172923 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:46.172883    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:47.423543 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:47.423493    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:50.638261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:50.638209    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:51.175360 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.175323    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"]
Oct 30 20:28:51.178944 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.178919    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.239831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.239136    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-a-9389b9-openshift-default-dockercfg-vsjk7\""
Oct 30 20:28:51.288424 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.288388    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"]
Oct 30 20:28:51.295395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.295353    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:51.326714 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.326676    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-podinfo\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.326939 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.326741    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-credential-socket\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.326939 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.326793    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-certs\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.326939 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.326888    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-token\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.327136 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.326981    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64qpx\" (UniqueName: \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-kube-api-access-64qpx\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.327136 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.327004    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-data\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.327136 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.327026    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-envoy\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.327136 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.327051    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-socket\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.327136 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.327079    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istiod-ca-cert\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.428776 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.428688    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-token\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.428980 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.428793    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64qpx\" (UniqueName: \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-kube-api-access-64qpx\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.428980 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.428840    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-data\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.428980 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.428873    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-envoy\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.428980 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.428909    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-socket\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.428980 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.428951    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istiod-ca-cert\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.429188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.429077    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-podinfo\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.429188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.429116    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-credential-socket\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.429333 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.429309    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-certs\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.429423 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.429345    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-data\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.429489 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.429456    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-socket\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.429538 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.429502    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-credential-socket\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.429669 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.429644    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-certs\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.429986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.429730    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istiod-ca-cert\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.431510 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.431485    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-envoy\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.431742 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.431723    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-podinfo\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.487712 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.487681    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64qpx\" (UniqueName: \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-kube-api-access-64qpx\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.487897 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.487681    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-token\") pod \"e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") " pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.491737 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.491710    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:51.558988 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.558505    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:51.935599 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.935561    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"]
Oct 30 20:28:51.941292 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:28:51.941244    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecfa928_d746_41c3_a9b4_b962d2c2c6d1.slice/crio-65139aca7acf3e270f3c6c6b6e14b4f93db80c94ff67376305e1b7f199bbec6e WatchSource:0}: Error finding container 65139aca7acf3e270f3c6c6b6e14b4f93db80c94ff67376305e1b7f199bbec6e: Status 404 returned error can't find the container with id 65139aca7acf3e270f3c6c6b6e14b4f93db80c94ff67376305e1b7f199bbec6e
Oct 30 20:28:51.943941 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.943909    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:28:51.944017 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.943986    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:28:51.944072 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.944016    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:28:51.990032 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:51.989999    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:52.749955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:52.749920    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" event={"ID":"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1","Type":"ContainerStarted","Data":"21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906"}
Oct 30 20:28:52.750149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:52.749981    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" event={"ID":"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1","Type":"ContainerStarted","Data":"65139aca7acf3e270f3c6c6b6e14b4f93db80c94ff67376305e1b7f199bbec6e"}
Oct 30 20:28:52.866438 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:52.866384    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" podStartSLOduration=1.866369047 podStartE2EDuration="1.866369047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:28:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:28:52.86426257 +0000 UTC m=+3795.407069837" watchObservedRunningTime="2026-10-30 20:28:52.866369047 +0000 UTC m=+3795.409176380"
Oct 30 20:28:53.492625 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:53.492593    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:53.498801 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:53.498770    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:53.758740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:53.758654    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:53.759581 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:53.759558    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:28:55.742942 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:55.742904    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:55.979517 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:55.979476    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:56.798248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:56.798202    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:58.216545 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:28:58.216506    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:28:59.193899 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:59.193851    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:28:59.365755 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:28:59.365718    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:00.574756 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:00.574725    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:00.836033 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:00.835911    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:01.158820 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.158706    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4" podUID="ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" containerName="main" containerID="cri-o://23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d" gracePeriod=45
Oct 30 20:29:01.445851 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.445633    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:29:01.464696 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.464661    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-kube-api-access-6wlcs\" (UniqueName: \"kubernetes.io/projected/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-kube-api-access-6wlcs\") pod \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") "
Oct 30 20:29:01.464923 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.464719    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-dshm\") pod \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") "
Oct 30 20:29:01.464923 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.464741    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tmp-dir\") pod \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") "
Oct 30 20:29:01.465021 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.464991    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tls-certs\" (UniqueName: \"kubernetes.io/secret/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tls-certs\") pod \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") "
Oct 30 20:29:01.465100 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.465083    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-home\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-home\") pod \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") "
Oct 30 20:29:01.465165 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.465135    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-model-cache\") pod \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\" (UID: \"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8\") "
Oct 30 20:29:01.465165 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.465154    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tmp-dir" pod "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" (UID: "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:29:01.465631 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.465344    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-home" pod "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" (UID: "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:29:01.465631 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.465574    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-model-cache" pod "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" (UID: "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:29:01.466017 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.465724    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:01.466017 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.465742    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:01.466017 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.465756    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:01.467617 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.467590    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tls-certs" pod "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" (UID: "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:29:01.467793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.467769    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-kube-api-access-6wlcs" pod "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" (UID: "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8"). InnerVolumeSpecName "kube-api-access-6wlcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:29:01.470759 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.470721    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-dshm" pod "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" (UID: "ffc6c70a-8f3e-4d28-88aa-049047f9c2a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:29:01.481865 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.481834    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:01.566962 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.566926    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:01.566962 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.566957    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wlcs\" (UniqueName: \"kubernetes.io/projected/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-kube-api-access-6wlcs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:01.566962 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.566971    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:01.729014 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.717354    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:01.819710 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.819679    6015 generic.go:356] "Generic (PLEG): container finished" podID="ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" containerID="23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d" exitCode=0
Oct 30 20:29:01.819926 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.819729    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"
Oct 30 20:29:01.819926 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.819754    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4" event={"ID":"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8","Type":"ContainerDied","Data":"23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d"}
Oct 30 20:29:01.819926 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.819832    6015 scope.go:122] "RemoveContainer" containerID="23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d"
Oct 30 20:29:01.819926 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.819800    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4" event={"ID":"ffc6c70a-8f3e-4d28-88aa-049047f9c2a8","Type":"ContainerDied","Data":"0b0245f35ef17d279ce0e2ca3cc49bab0820fd77416cf7aae391bab24dac3123"}
Oct 30 20:29:01.834653 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.834629    6015 scope.go:122] "RemoveContainer" containerID="23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d"
Oct 30 20:29:01.835049 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:29:01.835018    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d\": container with ID starting with 23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d not found: ID does not exist" containerID="23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d"
Oct 30 20:29:01.835150 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.835070    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d"} err="failed to get container status \"23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d\": rpc error: code = NotFound desc = could not find container \"23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d\": container with ID starting with 23b99664214c214777e201ed36282160bf81aee7e6b0ec6fe01014cdd237536d not found: ID does not exist"
Oct 30 20:29:01.920188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:01.920144    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:02.036047 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:02.035947    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"]
Oct 30 20:29:02.038615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:02.038580    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-fe49e7/auth-test-model-fe49e7-kserve-59fccfcd8f-lmbx4"]
Oct 30 20:29:03.586540 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:03.586502    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" path="/var/lib/kubelet/pods/ffc6c70a-8f3e-4d28-88aa-049047f9c2a8/volumes"
Oct 30 20:29:06.493515 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:06.493473    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:06.852923 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:06.852883    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:07.022922 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:07.022889    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:07.529703 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:07.529646    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:08.019833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.019034    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:08.554239 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.554186    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"]
Oct 30 20:29:08.555155 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.555128    6015 cpu_manager.go:414] "containerMap: removing container" podUID="ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" containerName="main"
Oct 30 20:29:08.555155 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.555155    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" containerName="main"
Oct 30 20:29:08.555382 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.555366    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="ffc6c70a-8f3e-4d28-88aa-049047f9c2a8" containerName="main"
Oct 30 20:29:08.560438 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.560410    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.610795 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.610759    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w4-b91df1-openshift-default-dockercfg-h64q9\""
Oct 30 20:29:08.655073 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.655030    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:08.661065 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.661034    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"]
Oct 30 20:29:08.664785 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.664750    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-credential-socket\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.664986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.664860    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-envoy\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.664986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.664894    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-podinfo\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.665113 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.665009    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-socket\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.665113 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.665051    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cpbg\" (UniqueName: \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-kube-api-access-9cpbg\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.665113 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.665094    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istiod-ca-cert\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.665335 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.665312    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-data\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.665477 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.665365    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-token\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.665477 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.665389    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-certs\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.766975 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.766940    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-data\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.767757 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.767732    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-token\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.768293 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.768271    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-certs\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.768745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.768726    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-credential-socket\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.769266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.769246    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-envoy\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.769723 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.769704    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-podinfo\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.771059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.770953    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-socket\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.771059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.771016    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cpbg\" (UniqueName: \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-kube-api-access-9cpbg\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.771059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.771051    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istiod-ca-cert\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.771705 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.771683    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istiod-ca-cert\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.771794 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.769156    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-credential-socket\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.771990 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.771965    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-socket\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.772083 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.768652    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-certs\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.772245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.767625    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-data\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.784840 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.784163    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-envoy\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.784840 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.784795    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-podinfo\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.827032 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.826955    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-token\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.833045 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.833009    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cpbg\" (UniqueName: \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-kube-api-access-9cpbg\") pod \"e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") " pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:08.872709 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.872669    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:08.877727 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:08.877694    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:09.324071 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:09.324034    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"]
Oct 30 20:29:09.329315 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:29:09.329279    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafc16ca4_a83c_41aa_8853_5bb0ec6d58e5.slice/crio-52f405faab31242adf582e6f8372dea715cbd528e1076b9928c51605548f234e WatchSource:0}: Error finding container 52f405faab31242adf582e6f8372dea715cbd528e1076b9928c51605548f234e: Status 404 returned error can't find the container with id 52f405faab31242adf582e6f8372dea715cbd528e1076b9928c51605548f234e
Oct 30 20:29:09.332157 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:09.332125    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:29:09.332234 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:09.332201    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:29:09.332272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:09.332231    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:29:09.878504 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:09.878461    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" event={"ID":"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5","Type":"ContainerStarted","Data":"7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc"}
Oct 30 20:29:09.879008 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:09.878515    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" event={"ID":"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5","Type":"ContainerStarted","Data":"52f405faab31242adf582e6f8372dea715cbd528e1076b9928c51605548f234e"}
Oct 30 20:29:09.908497 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:09.908457    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:09.997219 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:09.997161    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" podStartSLOduration=1.997146509 podStartE2EDuration="1.997146509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:29:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:29:09.993994507 +0000 UTC m=+3812.536801774" watchObservedRunningTime="2026-10-30 20:29:09.997146509 +0000 UTC m=+3812.539953773"
Oct 30 20:29:10.088189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:10.088151    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:10.878235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:10.878190    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:10.885317 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:10.885284    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:10.885769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:10.885633    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:10.886560 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:10.886542    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:29:11.522008 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:11.521974    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:12.031450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.031408    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:12.211432 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.211400    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:12.589548 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.589513    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"]
Oct 30 20:29:12.594349 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.594317    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:29:12.700188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.700155    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-a-8d612c-dockercfg-hrdcp\""
Oct 30 20:29:12.700405 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.700305    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-a-8d612c\""
Oct 30 20:29:12.704170 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.704140    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"]
Oct 30 20:29:12.732453 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.732420    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8925a4-5ca5-487c-bbf6-b820e636eda1-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq\" (UID: \"1a8925a4-5ca5-487c-bbf6-b820e636eda1\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:29:12.732681 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.732479    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw4n6\" (UniqueName: \"kubernetes.io/projected/1a8925a4-5ca5-487c-bbf6-b820e636eda1-kube-api-access-qw4n6\") pod \"payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq\" (UID: \"1a8925a4-5ca5-487c-bbf6-b820e636eda1\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:29:12.834528 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.834487    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8925a4-5ca5-487c-bbf6-b820e636eda1-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq\" (UID: \"1a8925a4-5ca5-487c-bbf6-b820e636eda1\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:29:12.834731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.834555    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw4n6\" (UniqueName: \"kubernetes.io/projected/1a8925a4-5ca5-487c-bbf6-b820e636eda1-kube-api-access-qw4n6\") pod \"payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq\" (UID: \"1a8925a4-5ca5-487c-bbf6-b820e636eda1\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:29:12.835235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.835204    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8925a4-5ca5-487c-bbf6-b820e636eda1-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq\" (UID: \"1a8925a4-5ca5-487c-bbf6-b820e636eda1\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:29:12.893708 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.893628    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw4n6\" (UniqueName: \"kubernetes.io/projected/1a8925a4-5ca5-487c-bbf6-b820e636eda1-kube-api-access-qw4n6\") pod \"payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq\" (UID: \"1a8925a4-5ca5-487c-bbf6-b820e636eda1\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:29:12.923016 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:12.922948    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:29:13.303882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:13.303830    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"]
Oct 30 20:29:13.308983 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:29:13.308946    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8925a4_5ca5_487c_bbf6_b820e636eda1.slice/crio-03528a4e8973762b7b8c757655589c48158e4c7bd389d8b7e0a219fc4dd996f7 WatchSource:0}: Error finding container 03528a4e8973762b7b8c757655589c48158e4c7bd389d8b7e0a219fc4dd996f7: Status 404 returned error can't find the container with id 03528a4e8973762b7b8c757655589c48158e4c7bd389d8b7e0a219fc4dd996f7
Oct 30 20:29:13.523923 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:13.523880    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:13.726831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:13.726713    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:13.887244 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:13.887196    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:13.909048 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:13.909016    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq" event={"ID":"1a8925a4-5ca5-487c-bbf6-b820e636eda1","Type":"ContainerStarted","Data":"27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9"}
Oct 30 20:29:13.909241 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:13.909073    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq" event={"ID":"1a8925a4-5ca5-487c-bbf6-b820e636eda1","Type":"ContainerStarted","Data":"03528a4e8973762b7b8c757655589c48158e4c7bd389d8b7e0a219fc4dd996f7"}
Oct 30 20:29:13.909241 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:13.909225    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:29:14.018932 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:14.018770    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq" podStartSLOduration=2.018739283 podStartE2EDuration="2.018739283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:29:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:29:14.018417921 +0000 UTC m=+3816.561225184" watchObservedRunningTime="2026-10-30 20:29:14.018739283 +0000 UTC m=+3816.561546549"
Oct 30 20:29:16.584334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:16.584294    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:17.062116 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:17.062081    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:17.236695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:17.236649    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:21.362640 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:21.362591    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:21.862468 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:21.862431    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"]
Oct 30 20:29:21.889458 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:21.889422    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:24.918893 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:24.918856    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:29:25.907191 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:25.907153    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:26.096450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:26.096403    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:26.261169 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:26.261077    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:28.219008 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:29:28.218962    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:29:30.602128 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:30.602088    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:34.462663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:34.462614    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:35.374667 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:35.374627    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:36.885221 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:36.885177    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht" podUID="3e0c9a0d-1cf6-4a40-9591-81e467234036" containerName="main" containerID="cri-o://68b6054bed0a644965095f797cc62256ec3eb45293326b060fb69f3e912214c8" gracePeriod=45
Oct 30 20:29:37.087027 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.086923    6015 generic.go:356] "Generic (PLEG): container finished" podID="3e0c9a0d-1cf6-4a40-9591-81e467234036" containerID="68b6054bed0a644965095f797cc62256ec3eb45293326b060fb69f3e912214c8" exitCode=0
Oct 30 20:29:37.087353 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.087331    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht" event={"ID":"3e0c9a0d-1cf6-4a40-9591-81e467234036","Type":"ContainerDied","Data":"68b6054bed0a644965095f797cc62256ec3eb45293326b060fb69f3e912214c8"}
Oct 30 20:29:37.173030 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.173000    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:29:37.290290 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.290251    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-model-cache\") pod \"3e0c9a0d-1cf6-4a40-9591-81e467234036\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") "
Oct 30 20:29:37.290491 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.290313    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-dshm\") pod \"3e0c9a0d-1cf6-4a40-9591-81e467234036\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") "
Oct 30 20:29:37.290491 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.290486    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e0c9a0d-1cf6-4a40-9591-81e467234036-kube-api-access-bvgz8\" (UniqueName: \"kubernetes.io/projected/3e0c9a0d-1cf6-4a40-9591-81e467234036-kube-api-access-bvgz8\") pod \"3e0c9a0d-1cf6-4a40-9591-81e467234036\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") "
Oct 30 20:29:37.290596 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.290513    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-home\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-home\") pod \"3e0c9a0d-1cf6-4a40-9591-81e467234036\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") "
Oct 30 20:29:37.290670 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.290649    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-tmp-dir\") pod \"3e0c9a0d-1cf6-4a40-9591-81e467234036\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") "
Oct 30 20:29:37.290953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.290936    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e0c9a0d-1cf6-4a40-9591-81e467234036-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e0c9a0d-1cf6-4a40-9591-81e467234036-tls-certs\") pod \"3e0c9a0d-1cf6-4a40-9591-81e467234036\" (UID: \"3e0c9a0d-1cf6-4a40-9591-81e467234036\") "
Oct 30 20:29:37.291238 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.291209    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-model-cache" pod "3e0c9a0d-1cf6-4a40-9591-81e467234036" (UID: "3e0c9a0d-1cf6-4a40-9591-81e467234036"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:29:37.291320 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.291295    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-home" pod "3e0c9a0d-1cf6-4a40-9591-81e467234036" (UID: "3e0c9a0d-1cf6-4a40-9591-81e467234036"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:29:37.291436 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.291414    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-tmp-dir" pod "3e0c9a0d-1cf6-4a40-9591-81e467234036" (UID: "3e0c9a0d-1cf6-4a40-9591-81e467234036"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:29:37.291898 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.291871    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:37.292008 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.291899    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:37.292008 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.291914    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:37.293786 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.293763    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e0c9a0d-1cf6-4a40-9591-81e467234036-kube-api-access-bvgz8" pod "3e0c9a0d-1cf6-4a40-9591-81e467234036" (UID: "3e0c9a0d-1cf6-4a40-9591-81e467234036"). InnerVolumeSpecName "kube-api-access-bvgz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:29:37.300967 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.300932    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-dshm" pod "3e0c9a0d-1cf6-4a40-9591-81e467234036" (UID: "3e0c9a0d-1cf6-4a40-9591-81e467234036"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:29:37.307629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.307595    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e0c9a0d-1cf6-4a40-9591-81e467234036-tls-certs" pod "3e0c9a0d-1cf6-4a40-9591-81e467234036" (UID: "3e0c9a0d-1cf6-4a40-9591-81e467234036"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:29:37.393773 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.393665    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e0c9a0d-1cf6-4a40-9591-81e467234036-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:37.393773 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.393718    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvgz8\" (UniqueName: \"kubernetes.io/projected/3e0c9a0d-1cf6-4a40-9591-81e467234036-kube-api-access-bvgz8\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:37.393773 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:37.393734    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e0c9a0d-1cf6-4a40-9591-81e467234036-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:29:38.097197 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:38.097166    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"
Oct 30 20:29:38.097661 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:38.097200    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht" event={"ID":"3e0c9a0d-1cf6-4a40-9591-81e467234036","Type":"ContainerDied","Data":"76f91835d32352a956fd05c64a2f0cd79d2b1ef1bebca041f22f69140b985a7a"}
Oct 30 20:29:38.097661 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:38.097268    6015 scope.go:122] "RemoveContainer" containerID="68b6054bed0a644965095f797cc62256ec3eb45293326b060fb69f3e912214c8"
Oct 30 20:29:38.254045 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:38.254006    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"]
Oct 30 20:29:38.300797 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:38.300759    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w1-b37684/auth-test-model-b37684-kserve-d98cf4f7c-5trht"]
Oct 30 20:29:39.587949 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:39.587913    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e0c9a0d-1cf6-4a40-9591-81e467234036" path="/var/lib/kubelet/pods/3e0c9a0d-1cf6-4a40-9591-81e467234036/volumes"
Oct 30 20:29:40.083050 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:40.083018    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:44.576236 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:44.576189    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:49.097899 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:49.097838    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:53.663048 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:53.663004    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:29:58.216414 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:29:58.216372    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:29:58.469684 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:29:58.469586    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:00.188059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.188022    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"]
Oct 30 20:30:00.188630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.188616    6015 cpu_manager.go:414] "containerMap: removing container" podUID="3e0c9a0d-1cf6-4a40-9591-81e467234036" containerName="main"
Oct 30 20:30:00.188681 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.188631    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e0c9a0d-1cf6-4a40-9591-81e467234036" containerName="main"
Oct 30 20:30:00.188773 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.188764    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e0c9a0d-1cf6-4a40-9591-81e467234036" containerName="main"
Oct 30 20:30:00.193109 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.193080    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"
Oct 30 20:30:00.205920 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.205890    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"]
Oct 30 20:30:00.211114 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.211088    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"
Oct 30 20:30:00.219728 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.219701    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"]
Oct 30 20:30:00.225645 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.225426    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"
Oct 30 20:30:00.282717 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.282677    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"]
Oct 30 20:30:00.289520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.288864    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"]
Oct 30 20:30:00.289520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.288992    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"
Oct 30 20:30:00.295476 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.295451    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"]
Oct 30 20:30:00.297882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.297859    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"
Oct 30 20:30:00.317480 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.317439    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"]
Oct 30 20:30:00.331005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.321523    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"
Oct 30 20:30:00.331005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.323579    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68dgj\" (UniqueName: \"kubernetes.io/projected/790b5c5f-5091-4af7-9377-902d0382b983-kube-api-access-68dgj\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg\" (UID: \"790b5c5f-5091-4af7-9377-902d0382b983\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"
Oct 30 20:30:00.331005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.323656    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b7z9\" (UniqueName: \"kubernetes.io/projected/91ee5770-80b5-4592-9831-162edf44ab5c-kube-api-access-7b7z9\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9\" (UID: \"91ee5770-80b5-4592-9831-162edf44ab5c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"
Oct 30 20:30:00.331005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.323769    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91ee5770-80b5-4592-9831-162edf44ab5c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9\" (UID: \"91ee5770-80b5-4592-9831-162edf44ab5c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"
Oct 30 20:30:00.331005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.323912    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8g68\" (UniqueName: \"kubernetes.io/projected/b65972dd-bdcc-49fe-87ee-1d7068021ef5-kube-api-access-f8g68\") pod \"maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj\" (UID: \"b65972dd-bdcc-49fe-87ee-1d7068021ef5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"
Oct 30 20:30:00.331005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.323957    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790b5c5f-5091-4af7-9377-902d0382b983-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg\" (UID: \"790b5c5f-5091-4af7-9377-902d0382b983\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"
Oct 30 20:30:00.331005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.324025    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65972dd-bdcc-49fe-87ee-1d7068021ef5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj\" (UID: \"b65972dd-bdcc-49fe-87ee-1d7068021ef5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"
Oct 30 20:30:00.342679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.342642    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kmwqm\""
Oct 30 20:30:00.398681 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.398639    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"]
Oct 30 20:30:00.398960 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.398702    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"]
Oct 30 20:30:00.398960 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.398728    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"]
Oct 30 20:30:00.398960 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.398758    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"]
Oct 30 20:30:00.398960 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.398885    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"
Oct 30 20:30:00.401772 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.401746    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"]
Oct 30 20:30:00.412317 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.412294    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"]
Oct 30 20:30:00.425752 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.425714    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm7zt\" (UniqueName: \"kubernetes.io/projected/569ff3bf-3e70-4721-839f-81c1eed209ce-kube-api-access-wm7zt\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj\" (UID: \"569ff3bf-3e70-4721-839f-81c1eed209ce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"
Oct 30 20:30:00.425953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.425780    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqnxv\" (UniqueName: \"kubernetes.io/projected/36907f92-2260-448b-a669-ea1c00e4ac15-kube-api-access-mqnxv\") pod \"maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk\" (UID: \"36907f92-2260-448b-a669-ea1c00e4ac15\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"
Oct 30 20:30:00.425953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.425833    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91ee5770-80b5-4592-9831-162edf44ab5c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9\" (UID: \"91ee5770-80b5-4592-9831-162edf44ab5c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"
Oct 30 20:30:00.425953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.425945    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8g68\" (UniqueName: \"kubernetes.io/projected/b65972dd-bdcc-49fe-87ee-1d7068021ef5-kube-api-access-f8g68\") pod \"maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj\" (UID: \"b65972dd-bdcc-49fe-87ee-1d7068021ef5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"
Oct 30 20:30:00.426075 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.425981    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790b5c5f-5091-4af7-9377-902d0382b983-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg\" (UID: \"790b5c5f-5091-4af7-9377-902d0382b983\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"
Oct 30 20:30:00.426075 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.426041    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65972dd-bdcc-49fe-87ee-1d7068021ef5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj\" (UID: \"b65972dd-bdcc-49fe-87ee-1d7068021ef5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"
Oct 30 20:30:00.426140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.426086    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7\" (UID: \"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"
Oct 30 20:30:00.426181 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.426155    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/569ff3bf-3e70-4721-839f-81c1eed209ce-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj\" (UID: \"569ff3bf-3e70-4721-839f-81c1eed209ce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"
Oct 30 20:30:00.426306 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.426194    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68dgj\" (UniqueName: \"kubernetes.io/projected/790b5c5f-5091-4af7-9377-902d0382b983-kube-api-access-68dgj\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg\" (UID: \"790b5c5f-5091-4af7-9377-902d0382b983\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"
Oct 30 20:30:00.426306 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.426228    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36907f92-2260-448b-a669-ea1c00e4ac15-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk\" (UID: \"36907f92-2260-448b-a669-ea1c00e4ac15\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"
Oct 30 20:30:00.426306 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.426284    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b7z9\" (UniqueName: \"kubernetes.io/projected/91ee5770-80b5-4592-9831-162edf44ab5c-kube-api-access-7b7z9\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9\" (UID: \"91ee5770-80b5-4592-9831-162edf44ab5c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"
Oct 30 20:30:00.426477 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.426350    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hgd7\" (UniqueName: \"kubernetes.io/projected/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-kube-api-access-8hgd7\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7\" (UID: \"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"
Oct 30 20:30:00.427194 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.427170    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790b5c5f-5091-4af7-9377-902d0382b983-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg\" (UID: \"790b5c5f-5091-4af7-9377-902d0382b983\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"
Oct 30 20:30:00.427246 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.427180    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91ee5770-80b5-4592-9831-162edf44ab5c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9\" (UID: \"91ee5770-80b5-4592-9831-162edf44ab5c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"
Oct 30 20:30:00.427875 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.427856    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65972dd-bdcc-49fe-87ee-1d7068021ef5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj\" (UID: \"b65972dd-bdcc-49fe-87ee-1d7068021ef5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"
Oct 30 20:30:00.449649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.449569    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"]
Oct 30 20:30:00.485185 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.485156    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8g68\" (UniqueName: \"kubernetes.io/projected/b65972dd-bdcc-49fe-87ee-1d7068021ef5-kube-api-access-f8g68\") pod \"maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj\" (UID: \"b65972dd-bdcc-49fe-87ee-1d7068021ef5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"
Oct 30 20:30:00.490337 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.490306    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68dgj\" (UniqueName: \"kubernetes.io/projected/790b5c5f-5091-4af7-9377-902d0382b983-kube-api-access-68dgj\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg\" (UID: \"790b5c5f-5091-4af7-9377-902d0382b983\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"
Oct 30 20:30:00.490679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.490653    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b7z9\" (UniqueName: \"kubernetes.io/projected/91ee5770-80b5-4592-9831-162edf44ab5c-kube-api-access-7b7z9\") pod \"maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9\" (UID: \"91ee5770-80b5-4592-9831-162edf44ab5c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"
Oct 30 20:30:00.507465 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.507427    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"
Oct 30 20:30:00.528128 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.528083    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7\" (UID: \"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"
Oct 30 20:30:00.528292 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.528158    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/569ff3bf-3e70-4721-839f-81c1eed209ce-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj\" (UID: \"569ff3bf-3e70-4721-839f-81c1eed209ce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"
Oct 30 20:30:00.528292 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.528190    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36907f92-2260-448b-a669-ea1c00e4ac15-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk\" (UID: \"36907f92-2260-448b-a669-ea1c00e4ac15\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"
Oct 30 20:30:00.528292 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.528218    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw8sb\" (UniqueName: \"kubernetes.io/projected/a83151a2-417d-4c71-88d0-504e0871b155-kube-api-access-cw8sb\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq\" (UID: \"a83151a2-417d-4c71-88d0-504e0871b155\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"
Oct 30 20:30:00.528474 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.528298    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hgd7\" (UniqueName: \"kubernetes.io/projected/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-kube-api-access-8hgd7\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7\" (UID: \"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"
Oct 30 20:30:00.528474 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.528400    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm7zt\" (UniqueName: \"kubernetes.io/projected/569ff3bf-3e70-4721-839f-81c1eed209ce-kube-api-access-wm7zt\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj\" (UID: \"569ff3bf-3e70-4721-839f-81c1eed209ce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"
Oct 30 20:30:00.528474 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.528467    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqnxv\" (UniqueName: \"kubernetes.io/projected/36907f92-2260-448b-a669-ea1c00e4ac15-kube-api-access-mqnxv\") pod \"maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk\" (UID: \"36907f92-2260-448b-a669-ea1c00e4ac15\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"
Oct 30 20:30:00.528652 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.528502    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a83151a2-417d-4c71-88d0-504e0871b155-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq\" (UID: \"a83151a2-417d-4c71-88d0-504e0871b155\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"
Oct 30 20:30:00.529040 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.529022    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/569ff3bf-3e70-4721-839f-81c1eed209ce-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj\" (UID: \"569ff3bf-3e70-4721-839f-81c1eed209ce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"
Oct 30 20:30:00.529040 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.529032    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7\" (UID: \"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"
Oct 30 20:30:00.529191 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.529039    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36907f92-2260-448b-a669-ea1c00e4ac15-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk\" (UID: \"36907f92-2260-448b-a669-ea1c00e4ac15\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"
Oct 30 20:30:00.583276 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.583191    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"
Oct 30 20:30:00.596324 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.595622    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm7zt\" (UniqueName: \"kubernetes.io/projected/569ff3bf-3e70-4721-839f-81c1eed209ce-kube-api-access-wm7zt\") pod \"maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj\" (UID: \"569ff3bf-3e70-4721-839f-81c1eed209ce\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"
Oct 30 20:30:00.596324 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.596144    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hgd7\" (UniqueName: \"kubernetes.io/projected/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-kube-api-access-8hgd7\") pod \"maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7\" (UID: \"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"
Oct 30 20:30:00.602794 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.602758    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqnxv\" (UniqueName: \"kubernetes.io/projected/36907f92-2260-448b-a669-ea1c00e4ac15-kube-api-access-mqnxv\") pod \"maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk\" (UID: \"36907f92-2260-448b-a669-ea1c00e4ac15\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"
Oct 30 20:30:00.616726 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.616511    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"
Oct 30 20:30:00.630412 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.630369    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw8sb\" (UniqueName: \"kubernetes.io/projected/a83151a2-417d-4c71-88d0-504e0871b155-kube-api-access-cw8sb\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq\" (UID: \"a83151a2-417d-4c71-88d0-504e0871b155\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"
Oct 30 20:30:00.630596 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.630496    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a83151a2-417d-4c71-88d0-504e0871b155-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq\" (UID: \"a83151a2-417d-4c71-88d0-504e0871b155\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"
Oct 30 20:30:00.631297 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.631273    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a83151a2-417d-4c71-88d0-504e0871b155-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq\" (UID: \"a83151a2-417d-4c71-88d0-504e0871b155\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"
Oct 30 20:30:00.640765 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.640737    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"
Oct 30 20:30:00.679206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.678921    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"
Oct 30 20:30:00.697617 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.697578    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw8sb\" (UniqueName: \"kubernetes.io/projected/a83151a2-417d-4c71-88d0-504e0871b155-kube-api-access-cw8sb\") pod \"maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq\" (UID: \"a83151a2-417d-4c71-88d0-504e0871b155\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"
Oct 30 20:30:00.702483 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.702219    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"
Oct 30 20:30:00.720004 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.719727    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"
Oct 30 20:30:00.892472 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.892439    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"]
Oct 30 20:30:00.897149 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:30:00.897120    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790b5c5f_5091_4af7_9377_902d0382b983.slice/crio-a9022760bf74b416ef11165e4a5a7cf44d7ead42d861266ee578fe6c5c14eef7 WatchSource:0}: Error finding container a9022760bf74b416ef11165e4a5a7cf44d7ead42d861266ee578fe6c5c14eef7: Status 404 returned error can't find the container with id a9022760bf74b416ef11165e4a5a7cf44d7ead42d861266ee578fe6c5c14eef7
Oct 30 20:30:00.959226 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.959131    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:00.987359 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:00.987326    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"]
Oct 30 20:30:01.014784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.014747    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"]
Oct 30 20:30:01.068428 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:30:01.068388    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ee5770_80b5_4592_9831_162edf44ab5c.slice/crio-8a0d8bac07f637673d0a1a1caf6107a867c7f1345d32770465cd59ccffcba41d WatchSource:0}: Error finding container 8a0d8bac07f637673d0a1a1caf6107a867c7f1345d32770465cd59ccffcba41d: Status 404 returned error can't find the container with id 8a0d8bac07f637673d0a1a1caf6107a867c7f1345d32770465cd59ccffcba41d
Oct 30 20:30:01.069665 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:30:01.069087    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65972dd_bdcc_49fe_87ee_1d7068021ef5.slice/crio-7b33360eeedf756e99027bf198aec1ccd5c9a0f34336378c83d63ef9a4f0045b WatchSource:0}: Error finding container 7b33360eeedf756e99027bf198aec1ccd5c9a0f34336378c83d63ef9a4f0045b: Status 404 returned error can't find the container with id 7b33360eeedf756e99027bf198aec1ccd5c9a0f34336378c83d63ef9a4f0045b
Oct 30 20:30:01.073962 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.073929    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"]
Oct 30 20:30:01.081476 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:30:01.081439    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9af3ea9_c8e8_4fcf_b87e_b4ffe7a47045.slice/crio-b7063f385d215bac3509c84fd921789334782323d5f83741941956e3f25ab8df WatchSource:0}: Error finding container b7063f385d215bac3509c84fd921789334782323d5f83741941956e3f25ab8df: Status 404 returned error can't find the container with id b7063f385d215bac3509c84fd921789334782323d5f83741941956e3f25ab8df
Oct 30 20:30:01.092657 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.092627    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"]
Oct 30 20:30:01.107415 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:30:01.107385    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569ff3bf_3e70_4721_839f_81c1eed209ce.slice/crio-9629bedb46f10102be71f7149d6de1bb6b56c25c45a0f53d9fccdf27ccf2eb4d WatchSource:0}: Error finding container 9629bedb46f10102be71f7149d6de1bb6b56c25c45a0f53d9fccdf27ccf2eb4d: Status 404 returned error can't find the container with id 9629bedb46f10102be71f7149d6de1bb6b56c25c45a0f53d9fccdf27ccf2eb4d
Oct 30 20:30:01.135431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.135383    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"]
Oct 30 20:30:01.144247 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:30:01.144193    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36907f92_2260_448b_a669_ea1c00e4ac15.slice/crio-158aa8500913ea570022eb8b9af9105c15cc04ea901cea31aa1a43bcf6958257 WatchSource:0}: Error finding container 158aa8500913ea570022eb8b9af9105c15cc04ea901cea31aa1a43bcf6958257: Status 404 returned error can't find the container with id 158aa8500913ea570022eb8b9af9105c15cc04ea901cea31aa1a43bcf6958257
Oct 30 20:30:01.164198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.164169    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"]
Oct 30 20:30:01.271279 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:30:01.271186    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda83151a2_417d_4c71_88d0_504e0871b155.slice/crio-1c7cd2047d65274585714bd3ba34ac59c8c5fde7f45dc2d39b9058f0bb3a02aa WatchSource:0}: Error finding container 1c7cd2047d65274585714bd3ba34ac59c8c5fde7f45dc2d39b9058f0bb3a02aa: Status 404 returned error can't find the container with id 1c7cd2047d65274585714bd3ba34ac59c8c5fde7f45dc2d39b9058f0bb3a02aa
Oct 30 20:30:01.300322 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.300295    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk" event={"ID":"36907f92-2260-448b-a669-ea1c00e4ac15","Type":"ContainerStarted","Data":"158aa8500913ea570022eb8b9af9105c15cc04ea901cea31aa1a43bcf6958257"}
Oct 30 20:30:01.301468 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.301440    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj" event={"ID":"b65972dd-bdcc-49fe-87ee-1d7068021ef5","Type":"ContainerStarted","Data":"7b33360eeedf756e99027bf198aec1ccd5c9a0f34336378c83d63ef9a4f0045b"}
Oct 30 20:30:01.302707 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.302685    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" event={"ID":"569ff3bf-3e70-4721-839f-81c1eed209ce","Type":"ContainerStarted","Data":"9629bedb46f10102be71f7149d6de1bb6b56c25c45a0f53d9fccdf27ccf2eb4d"}
Oct 30 20:30:01.303869 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.303845    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9" event={"ID":"91ee5770-80b5-4592-9831-162edf44ab5c","Type":"ContainerStarted","Data":"8a0d8bac07f637673d0a1a1caf6107a867c7f1345d32770465cd59ccffcba41d"}
Oct 30 20:30:01.304954 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.304935    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq" event={"ID":"a83151a2-417d-4c71-88d0-504e0871b155","Type":"ContainerStarted","Data":"1c7cd2047d65274585714bd3ba34ac59c8c5fde7f45dc2d39b9058f0bb3a02aa"}
Oct 30 20:30:01.305999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.305976    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" event={"ID":"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045","Type":"ContainerStarted","Data":"b7063f385d215bac3509c84fd921789334782323d5f83741941956e3f25ab8df"}
Oct 30 20:30:01.307102 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:01.307083    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg" event={"ID":"790b5c5f-5091-4af7-9377-902d0382b983","Type":"ContainerStarted","Data":"a9022760bf74b416ef11165e4a5a7cf44d7ead42d861266ee578fe6c5c14eef7"}
Oct 30 20:30:02.315433 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.315401    6015 generic.go:356] "Generic (PLEG): container finished" podID="a83151a2-417d-4c71-88d0-504e0871b155" containerID="1360efbb8e3ab4bbc17d0de2212dbb0534c62525c3ba954164916e922e7c5cb6" exitCode=60
Oct 30 20:30:02.316014 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.315483    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq" event={"ID":"a83151a2-417d-4c71-88d0-504e0871b155","Type":"ContainerDied","Data":"1360efbb8e3ab4bbc17d0de2212dbb0534c62525c3ba954164916e922e7c5cb6"}
Oct 30 20:30:02.316014 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.315841    6015 scope.go:122] "RemoveContainer" containerID="1360efbb8e3ab4bbc17d0de2212dbb0534c62525c3ba954164916e922e7c5cb6"
Oct 30 20:30:02.317340 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.317312    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" event={"ID":"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045","Type":"ContainerStarted","Data":"bcedc718974e9adc8d2b826f33ca0383bf243dd6cc8c257b243e1c0da696c6d5"}
Oct 30 20:30:02.319369 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.319167    6015 generic.go:356] "Generic (PLEG): container finished" podID="790b5c5f-5091-4af7-9377-902d0382b983" containerID="60e378d01a9afe22f9f26f9c3b96f77757f7eefdf8782ffea2af28e071fc199f" exitCode=60
Oct 30 20:30:02.319369 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.319251    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg" event={"ID":"790b5c5f-5091-4af7-9377-902d0382b983","Type":"ContainerDied","Data":"60e378d01a9afe22f9f26f9c3b96f77757f7eefdf8782ffea2af28e071fc199f"}
Oct 30 20:30:02.319519 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.319500    6015 scope.go:122] "RemoveContainer" containerID="60e378d01a9afe22f9f26f9c3b96f77757f7eefdf8782ffea2af28e071fc199f"
Oct 30 20:30:02.320969 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.320949    6015 generic.go:356] "Generic (PLEG): container finished" podID="36907f92-2260-448b-a669-ea1c00e4ac15" containerID="b1953071ce1237d53c21d5a7f0024cc67d922457b21d1d8ceea41faaee59cbcd" exitCode=60
Oct 30 20:30:02.321057 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.321027    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk" event={"ID":"36907f92-2260-448b-a669-ea1c00e4ac15","Type":"ContainerDied","Data":"b1953071ce1237d53c21d5a7f0024cc67d922457b21d1d8ceea41faaee59cbcd"}
Oct 30 20:30:02.321288 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.321272    6015 scope.go:122] "RemoveContainer" containerID="b1953071ce1237d53c21d5a7f0024cc67d922457b21d1d8ceea41faaee59cbcd"
Oct 30 20:30:02.322768 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.322743    6015 generic.go:356] "Generic (PLEG): container finished" podID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerID="21a0c7330d5748b1d55e39771b78c9260f898232574d092e784bc7102df49c34" exitCode=60
Oct 30 20:30:02.322906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.322792    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj" event={"ID":"b65972dd-bdcc-49fe-87ee-1d7068021ef5","Type":"ContainerDied","Data":"21a0c7330d5748b1d55e39771b78c9260f898232574d092e784bc7102df49c34"}
Oct 30 20:30:02.323063 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.323047    6015 scope.go:122] "RemoveContainer" containerID="21a0c7330d5748b1d55e39771b78c9260f898232574d092e784bc7102df49c34"
Oct 30 20:30:02.324452 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.324430    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" event={"ID":"569ff3bf-3e70-4721-839f-81c1eed209ce","Type":"ContainerStarted","Data":"02d09dfc77e747b2c7aff317b20b2e25be0f96e53370479d3a044701e4ca3f23"}
Oct 30 20:30:02.326045 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.326027    6015 generic.go:356] "Generic (PLEG): container finished" podID="91ee5770-80b5-4592-9831-162edf44ab5c" containerID="23434516d737fe68d853af8a9ad26c9056ba395a7611580e930b4a22bb96b9fa" exitCode=60
Oct 30 20:30:02.326122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.326051    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9" event={"ID":"91ee5770-80b5-4592-9831-162edf44ab5c","Type":"ContainerDied","Data":"23434516d737fe68d853af8a9ad26c9056ba395a7611580e930b4a22bb96b9fa"}
Oct 30 20:30:02.326338 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.326320    6015 scope.go:122] "RemoveContainer" containerID="23434516d737fe68d853af8a9ad26c9056ba395a7611580e930b4a22bb96b9fa"
Oct 30 20:30:02.538303 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:02.538177    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" podStartSLOduration=2.538158353 podStartE2EDuration="2.538158353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:30:02.536791483 +0000 UTC m=+3865.079598747" watchObservedRunningTime="2026-10-30 20:30:02.538158353 +0000 UTC m=+3865.080965618"
Oct 30 20:30:03.090868 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.090796    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" podStartSLOduration=3.09077988 podStartE2EDuration="3.09077988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:30:03.088581637 +0000 UTC m=+3865.631388914" watchObservedRunningTime="2026-10-30 20:30:03.09077988 +0000 UTC m=+3865.633587144"
Oct 30 20:30:03.336496 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.336399    6015 generic.go:356] "Generic (PLEG): container finished" podID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerID="bcedc718974e9adc8d2b826f33ca0383bf243dd6cc8c257b243e1c0da696c6d5" exitCode=60
Oct 30 20:30:03.336947 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.336486    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" event={"ID":"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045","Type":"ContainerDied","Data":"bcedc718974e9adc8d2b826f33ca0383bf243dd6cc8c257b243e1c0da696c6d5"}
Oct 30 20:30:03.336947 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.336797    6015 scope.go:122] "RemoveContainer" containerID="bcedc718974e9adc8d2b826f33ca0383bf243dd6cc8c257b243e1c0da696c6d5"
Oct 30 20:30:03.338655 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.338590    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg" event={"ID":"790b5c5f-5091-4af7-9377-902d0382b983","Type":"ContainerStarted","Data":"18a364d9df0149b532d5f5b1dd7a1bfbac2ee0c2294bc6b537bcad866efe3eb9"}
Oct 30 20:30:03.340867 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.340846    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk" event={"ID":"36907f92-2260-448b-a669-ea1c00e4ac15","Type":"ContainerStarted","Data":"53b79ab491819f8264a54e127f6ee538a3faaa6e8a73ed1714b6fa7263caf349"}
Oct 30 20:30:03.342441 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.342418    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj" event={"ID":"b65972dd-bdcc-49fe-87ee-1d7068021ef5","Type":"ContainerStarted","Data":"b07edf8aa817f9795ce9d48edcc75460102ce10c3cfe1eba2603adf79286a0b8"}
Oct 30 20:30:03.343647 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.343628    6015 generic.go:356] "Generic (PLEG): container finished" podID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerID="02d09dfc77e747b2c7aff317b20b2e25be0f96e53370479d3a044701e4ca3f23" exitCode=60
Oct 30 20:30:03.343751 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.343710    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" event={"ID":"569ff3bf-3e70-4721-839f-81c1eed209ce","Type":"ContainerDied","Data":"02d09dfc77e747b2c7aff317b20b2e25be0f96e53370479d3a044701e4ca3f23"}
Oct 30 20:30:03.343965 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.343947    6015 scope.go:122] "RemoveContainer" containerID="02d09dfc77e747b2c7aff317b20b2e25be0f96e53370479d3a044701e4ca3f23"
Oct 30 20:30:03.345663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.345640    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9" event={"ID":"91ee5770-80b5-4592-9831-162edf44ab5c","Type":"ContainerStarted","Data":"2aab4f6448874ea8942c6cb5b46830246fe3036054815fc87c1cf4fa42547c8d"}
Oct 30 20:30:03.347614 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.347591    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq" event={"ID":"a83151a2-417d-4c71-88d0-504e0871b155","Type":"ContainerStarted","Data":"fb90c0a9d0602cd6761461a7d0b042dbc62b45138717c93d1c216a48c8b0e600"}
Oct 30 20:30:03.541861 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.541800    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:03.557657 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.557602    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9" podStartSLOduration=3.557585291 podStartE2EDuration="3.557585291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:30:03.556101645 +0000 UTC m=+3866.098908930" watchObservedRunningTime="2026-10-30 20:30:03.557585291 +0000 UTC m=+3866.100392559"
Oct 30 20:30:03.668063 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.668008    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq" podStartSLOduration=3.667991493 podStartE2EDuration="3.667991493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:30:03.665362263 +0000 UTC m=+3866.208169553" watchObservedRunningTime="2026-10-30 20:30:03.667991493 +0000 UTC m=+3866.210798792"
Oct 30 20:30:03.889789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.889677    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg" podStartSLOduration=3.889657159 podStartE2EDuration="3.889657159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:30:03.887867239 +0000 UTC m=+3866.430674505" watchObservedRunningTime="2026-10-30 20:30:03.889657159 +0000 UTC m=+3866.432464426"
Oct 30 20:30:03.998875 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:03.998797    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk" podStartSLOduration=3.998782598 podStartE2EDuration="3.998782598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:30:03.998419293 +0000 UTC m=+3866.541226560" watchObservedRunningTime="2026-10-30 20:30:03.998782598 +0000 UTC m=+3866.541589863"
Oct 30 20:30:04.108361 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.108304    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj" podStartSLOduration=4.108288197 podStartE2EDuration="4.108288197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:30:04.107415677 +0000 UTC m=+3866.650222944" watchObservedRunningTime="2026-10-30 20:30:04.108288197 +0000 UTC m=+3866.651095461"
Oct 30 20:30:04.356649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.356617    6015 generic.go:356] "Generic (PLEG): container finished" podID="36907f92-2260-448b-a669-ea1c00e4ac15" containerID="53b79ab491819f8264a54e127f6ee538a3faaa6e8a73ed1714b6fa7263caf349" exitCode=60
Oct 30 20:30:04.357171 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.356715    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk" event={"ID":"36907f92-2260-448b-a669-ea1c00e4ac15","Type":"ContainerDied","Data":"53b79ab491819f8264a54e127f6ee538a3faaa6e8a73ed1714b6fa7263caf349"}
Oct 30 20:30:04.357171 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.356788    6015 scope.go:122] "RemoveContainer" containerID="b1953071ce1237d53c21d5a7f0024cc67d922457b21d1d8ceea41faaee59cbcd"
Oct 30 20:30:04.357171 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.357077    6015 scope.go:122] "RemoveContainer" containerID="53b79ab491819f8264a54e127f6ee538a3faaa6e8a73ed1714b6fa7263caf349"
Oct 30 20:30:04.357473 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:04.357447    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk_odh-ai-gateway-infra(36907f92-2260-448b-a669-ea1c00e4ac15)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk" podUID="36907f92-2260-448b-a669-ea1c00e4ac15"
Oct 30 20:30:04.359120 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.359097    6015 generic.go:356] "Generic (PLEG): container finished" podID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerID="b07edf8aa817f9795ce9d48edcc75460102ce10c3cfe1eba2603adf79286a0b8" exitCode=60
Oct 30 20:30:04.359233 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.359178    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj" event={"ID":"b65972dd-bdcc-49fe-87ee-1d7068021ef5","Type":"ContainerDied","Data":"b07edf8aa817f9795ce9d48edcc75460102ce10c3cfe1eba2603adf79286a0b8"}
Oct 30 20:30:04.359448 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.359431    6015 scope.go:122] "RemoveContainer" containerID="b07edf8aa817f9795ce9d48edcc75460102ce10c3cfe1eba2603adf79286a0b8"
Oct 30 20:30:04.359774 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:04.359752    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj_odh-ai-gateway-infra(b65972dd-bdcc-49fe-87ee-1d7068021ef5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5"
Oct 30 20:30:04.361314 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.361286    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" event={"ID":"569ff3bf-3e70-4721-839f-81c1eed209ce","Type":"ContainerStarted","Data":"9c18aa4389006cb57cad78b135aa89c4d6b16a6fd9b0675961acf26c472b850b"}
Oct 30 20:30:04.363396 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.363373    6015 generic.go:356] "Generic (PLEG): container finished" podID="91ee5770-80b5-4592-9831-162edf44ab5c" containerID="2aab4f6448874ea8942c6cb5b46830246fe3036054815fc87c1cf4fa42547c8d" exitCode=60
Oct 30 20:30:04.363498 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.363451    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9" event={"ID":"91ee5770-80b5-4592-9831-162edf44ab5c","Type":"ContainerDied","Data":"2aab4f6448874ea8942c6cb5b46830246fe3036054815fc87c1cf4fa42547c8d"}
Oct 30 20:30:04.363726 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.363707    6015 scope.go:122] "RemoveContainer" containerID="2aab4f6448874ea8942c6cb5b46830246fe3036054815fc87c1cf4fa42547c8d"
Oct 30 20:30:04.364151 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:04.364122    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9_odh-ai-gateway-infra(91ee5770-80b5-4592-9831-162edf44ab5c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9" podUID="91ee5770-80b5-4592-9831-162edf44ab5c"
Oct 30 20:30:04.365565 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.365543    6015 generic.go:356] "Generic (PLEG): container finished" podID="a83151a2-417d-4c71-88d0-504e0871b155" containerID="fb90c0a9d0602cd6761461a7d0b042dbc62b45138717c93d1c216a48c8b0e600" exitCode=60
Oct 30 20:30:04.365672 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.365624    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq" event={"ID":"a83151a2-417d-4c71-88d0-504e0871b155","Type":"ContainerDied","Data":"fb90c0a9d0602cd6761461a7d0b042dbc62b45138717c93d1c216a48c8b0e600"}
Oct 30 20:30:04.365934 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.365919    6015 scope.go:122] "RemoveContainer" containerID="fb90c0a9d0602cd6761461a7d0b042dbc62b45138717c93d1c216a48c8b0e600"
Oct 30 20:30:04.366264 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:04.366218    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq_odh-ai-gateway-infra(a83151a2-417d-4c71-88d0-504e0871b155)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq" podUID="a83151a2-417d-4c71-88d0-504e0871b155"
Oct 30 20:30:04.368551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.368523    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" event={"ID":"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045","Type":"ContainerStarted","Data":"2388d688203e58f03c86814dff1ebe7539fccfc1e9e597c89ff83b2b412c1cc2"}
Oct 30 20:30:04.370782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.370759    6015 generic.go:356] "Generic (PLEG): container finished" podID="790b5c5f-5091-4af7-9377-902d0382b983" containerID="18a364d9df0149b532d5f5b1dd7a1bfbac2ee0c2294bc6b537bcad866efe3eb9" exitCode=60
Oct 30 20:30:04.370891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.370852    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg" event={"ID":"790b5c5f-5091-4af7-9377-902d0382b983","Type":"ContainerDied","Data":"18a364d9df0149b532d5f5b1dd7a1bfbac2ee0c2294bc6b537bcad866efe3eb9"}
Oct 30 20:30:04.371099 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.371083    6015 scope.go:122] "RemoveContainer" containerID="18a364d9df0149b532d5f5b1dd7a1bfbac2ee0c2294bc6b537bcad866efe3eb9"
Oct 30 20:30:04.371378 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:04.371357    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg_odh-ai-gateway-infra(790b5c5f-5091-4af7-9377-902d0382b983)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg" podUID="790b5c5f-5091-4af7-9377-902d0382b983"
Oct 30 20:30:04.373800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.373781    6015 scope.go:122] "RemoveContainer" containerID="21a0c7330d5748b1d55e39771b78c9260f898232574d092e784bc7102df49c34"
Oct 30 20:30:04.388080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.388057    6015 scope.go:122] "RemoveContainer" containerID="23434516d737fe68d853af8a9ad26c9056ba395a7611580e930b4a22bb96b9fa"
Oct 30 20:30:04.401695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.401673    6015 scope.go:122] "RemoveContainer" containerID="1360efbb8e3ab4bbc17d0de2212dbb0534c62525c3ba954164916e922e7c5cb6"
Oct 30 20:30:04.415505 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:04.415485    6015 scope.go:122] "RemoveContainer" containerID="60e378d01a9afe22f9f26f9c3b96f77757f7eefdf8782ffea2af28e071fc199f"
Oct 30 20:30:05.381149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.381115    6015 generic.go:356] "Generic (PLEG): container finished" podID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerID="9c18aa4389006cb57cad78b135aa89c4d6b16a6fd9b0675961acf26c472b850b" exitCode=60
Oct 30 20:30:05.381672 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.381195    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" event={"ID":"569ff3bf-3e70-4721-839f-81c1eed209ce","Type":"ContainerDied","Data":"9c18aa4389006cb57cad78b135aa89c4d6b16a6fd9b0675961acf26c472b850b"}
Oct 30 20:30:05.381672 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.381258    6015 scope.go:122] "RemoveContainer" containerID="02d09dfc77e747b2c7aff317b20b2e25be0f96e53370479d3a044701e4ca3f23"
Oct 30 20:30:05.381672 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.381573    6015 scope.go:122] "RemoveContainer" containerID="9c18aa4389006cb57cad78b135aa89c4d6b16a6fd9b0675961acf26c472b850b"
Oct 30 20:30:05.382010 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:05.381982    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj_odh-ai-gateway-infra(569ff3bf-3e70-4721-839f-81c1eed209ce)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce"
Oct 30 20:30:05.383234 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.383204    6015 scope.go:122] "RemoveContainer" containerID="2aab4f6448874ea8942c6cb5b46830246fe3036054815fc87c1cf4fa42547c8d"
Oct 30 20:30:05.383604 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:05.383570    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9_odh-ai-gateway-infra(91ee5770-80b5-4592-9831-162edf44ab5c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9" podUID="91ee5770-80b5-4592-9831-162edf44ab5c"
Oct 30 20:30:05.384940 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.384922    6015 scope.go:122] "RemoveContainer" containerID="fb90c0a9d0602cd6761461a7d0b042dbc62b45138717c93d1c216a48c8b0e600"
Oct 30 20:30:05.385230 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:05.385204    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq_odh-ai-gateway-infra(a83151a2-417d-4c71-88d0-504e0871b155)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq" podUID="a83151a2-417d-4c71-88d0-504e0871b155"
Oct 30 20:30:05.386657 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.386633    6015 generic.go:356] "Generic (PLEG): container finished" podID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerID="2388d688203e58f03c86814dff1ebe7539fccfc1e9e597c89ff83b2b412c1cc2" exitCode=60
Oct 30 20:30:05.386735 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.386708    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" event={"ID":"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045","Type":"ContainerDied","Data":"2388d688203e58f03c86814dff1ebe7539fccfc1e9e597c89ff83b2b412c1cc2"}
Oct 30 20:30:05.386951 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.386936    6015 scope.go:122] "RemoveContainer" containerID="2388d688203e58f03c86814dff1ebe7539fccfc1e9e597c89ff83b2b412c1cc2"
Oct 30 20:30:05.387223 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:05.387202    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7_odh-ai-gateway-infra(a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045"
Oct 30 20:30:05.388760 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.388740    6015 scope.go:122] "RemoveContainer" containerID="18a364d9df0149b532d5f5b1dd7a1bfbac2ee0c2294bc6b537bcad866efe3eb9"
Oct 30 20:30:05.389052 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:05.389026    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg_odh-ai-gateway-infra(790b5c5f-5091-4af7-9377-902d0382b983)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg" podUID="790b5c5f-5091-4af7-9377-902d0382b983"
Oct 30 20:30:05.390569 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.390551    6015 scope.go:122] "RemoveContainer" containerID="53b79ab491819f8264a54e127f6ee538a3faaa6e8a73ed1714b6fa7263caf349"
Oct 30 20:30:05.390856 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:05.390798    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk_odh-ai-gateway-infra(36907f92-2260-448b-a669-ea1c00e4ac15)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk" podUID="36907f92-2260-448b-a669-ea1c00e4ac15"
Oct 30 20:30:05.392190 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.392174    6015 scope.go:122] "RemoveContainer" containerID="b07edf8aa817f9795ce9d48edcc75460102ce10c3cfe1eba2603adf79286a0b8"
Oct 30 20:30:05.392373 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:05.392357    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj_odh-ai-gateway-infra(b65972dd-bdcc-49fe-87ee-1d7068021ef5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5"
Oct 30 20:30:05.396705 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.396681    6015 scope.go:122] "RemoveContainer" containerID="bcedc718974e9adc8d2b826f33ca0383bf243dd6cc8c257b243e1c0da696c6d5"
Oct 30 20:30:05.580992 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:05.580950    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:06.251533 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:06.251492    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:06.401664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:06.401637    6015 scope.go:122] "RemoveContainer" containerID="9c18aa4389006cb57cad78b135aa89c4d6b16a6fd9b0675961acf26c472b850b"
Oct 30 20:30:06.402174 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:06.402025    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj_odh-ai-gateway-infra(569ff3bf-3e70-4721-839f-81c1eed209ce)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce"
Oct 30 20:30:06.403234 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:06.403214    6015 scope.go:122] "RemoveContainer" containerID="2388d688203e58f03c86814dff1ebe7539fccfc1e9e597c89ff83b2b412c1cc2"
Oct 30 20:30:06.403496 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:06.403477    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7_odh-ai-gateway-infra(a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045"
Oct 30 20:30:06.444701 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:06.444246    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:08.216319 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:08.216281    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:08.707430 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:08.707387    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:10.936422 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:10.936384    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:11.219258 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:11.219166    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:11.374186 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:11.374156    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:13.577528 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:13.577501    6015 scope.go:122] "RemoveContainer" containerID="53b79ab491819f8264a54e127f6ee538a3faaa6e8a73ed1714b6fa7263caf349"
Oct 30 20:30:14.181089 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.181047    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:14.350569 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.350528    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:14.465913 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.465865    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk" event={"ID":"36907f92-2260-448b-a669-ea1c00e4ac15","Type":"ContainerStarted","Data":"fc2ddce3002c0d6e4abf8cfbc5d479e5d66ab420ee6a9057edab31b26acc3c5a"}
Oct 30 20:30:14.580861 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.579410    6015 scope.go:122] "RemoveContainer" containerID="b07edf8aa817f9795ce9d48edcc75460102ce10c3cfe1eba2603adf79286a0b8"
Oct 30 20:30:14.581341 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.581140    6015 scope.go:122] "RemoveContainer" containerID="fb90c0a9d0602cd6761461a7d0b042dbc62b45138717c93d1c216a48c8b0e600"
Oct 30 20:30:14.586274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.586226    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:14.673362 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.673324    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"]
Oct 30 20:30:14.679256 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.679228    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:30:14.731016 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.730969    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ff662ee-f1de-4fd2-be9e-025803572c30-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b\" (UID: \"0ff662ee-f1de-4fd2-be9e-025803572c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:30:14.731223 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.731135    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql5ck\" (UniqueName: \"kubernetes.io/projected/0ff662ee-f1de-4fd2-be9e-025803572c30-kube-api-access-ql5ck\") pod \"payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b\" (UID: \"0ff662ee-f1de-4fd2-be9e-025803572c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:30:14.732994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.732439    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-79c649-dockercfg-5d5rj\""
Oct 30 20:30:14.734224 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.734160    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-79c649\""
Oct 30 20:30:14.739477 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.739452    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"]
Oct 30 20:30:14.826339 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.824893    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"]
Oct 30 20:30:14.839144 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.832925    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql5ck\" (UniqueName: \"kubernetes.io/projected/0ff662ee-f1de-4fd2-be9e-025803572c30-kube-api-access-ql5ck\") pod \"payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b\" (UID: \"0ff662ee-f1de-4fd2-be9e-025803572c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:30:14.839144 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.833197    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ff662ee-f1de-4fd2-be9e-025803572c30-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b\" (UID: \"0ff662ee-f1de-4fd2-be9e-025803572c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:30:14.839144 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.834161    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ff662ee-f1de-4fd2-be9e-025803572c30-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b\" (UID: \"0ff662ee-f1de-4fd2-be9e-025803572c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:30:14.839144 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.838768    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:30:14.885365 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.885335    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"]
Oct 30 20:30:14.895377 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.895319    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql5ck\" (UniqueName: \"kubernetes.io/projected/0ff662ee-f1de-4fd2-be9e-025803572c30-kube-api-access-ql5ck\") pod \"payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b\" (UID: \"0ff662ee-f1de-4fd2-be9e-025803572c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:30:14.934640 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.934598    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62efb92e-44a9-4959-afc8-206349712106-plugins-config-volume\") pod \"payload-processing-e2e-autores-79c649-5cf6767768-nl4l6\" (UID: \"62efb92e-44a9-4959-afc8-206349712106\") " pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:30:14.934989 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.934965    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzr87\" (UniqueName: \"kubernetes.io/projected/62efb92e-44a9-4959-afc8-206349712106-kube-api-access-jzr87\") pod \"payload-processing-e2e-autores-79c649-5cf6767768-nl4l6\" (UID: \"62efb92e-44a9-4959-afc8-206349712106\") " pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:30:14.993554 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:14.993517    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:30:15.036257 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.036110    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzr87\" (UniqueName: \"kubernetes.io/projected/62efb92e-44a9-4959-afc8-206349712106-kube-api-access-jzr87\") pod \"payload-processing-e2e-autores-79c649-5cf6767768-nl4l6\" (UID: \"62efb92e-44a9-4959-afc8-206349712106\") " pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:30:15.036257 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.036239    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62efb92e-44a9-4959-afc8-206349712106-plugins-config-volume\") pod \"payload-processing-e2e-autores-79c649-5cf6767768-nl4l6\" (UID: \"62efb92e-44a9-4959-afc8-206349712106\") " pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:30:15.037030 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.037005    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62efb92e-44a9-4959-afc8-206349712106-plugins-config-volume\") pod \"payload-processing-e2e-autores-79c649-5cf6767768-nl4l6\" (UID: \"62efb92e-44a9-4959-afc8-206349712106\") " pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:30:15.106971 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.105772    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzr87\" (UniqueName: \"kubernetes.io/projected/62efb92e-44a9-4959-afc8-206349712106-kube-api-access-jzr87\") pod \"payload-processing-e2e-autores-79c649-5cf6767768-nl4l6\" (UID: \"62efb92e-44a9-4959-afc8-206349712106\") " pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:30:15.157128 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.157033    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:30:15.386146 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.386111    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"]
Oct 30 20:30:15.389986 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:30:15.389943    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff662ee_f1de_4fd2_be9e_025803572c30.slice/crio-b4d8b9fd186780e5cf7be2e707e42d1df91686a3c4bbfb3969e183eae751aaac WatchSource:0}: Error finding container b4d8b9fd186780e5cf7be2e707e42d1df91686a3c4bbfb3969e183eae751aaac: Status 404 returned error can't find the container with id b4d8b9fd186780e5cf7be2e707e42d1df91686a3c4bbfb3969e183eae751aaac
Oct 30 20:30:15.485158 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.485111    6015 generic.go:356] "Generic (PLEG): container finished" podID="36907f92-2260-448b-a669-ea1c00e4ac15" containerID="fc2ddce3002c0d6e4abf8cfbc5d479e5d66ab420ee6a9057edab31b26acc3c5a" exitCode=60
Oct 30 20:30:15.485315 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.485226    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk" event={"ID":"36907f92-2260-448b-a669-ea1c00e4ac15","Type":"ContainerDied","Data":"fc2ddce3002c0d6e4abf8cfbc5d479e5d66ab420ee6a9057edab31b26acc3c5a"}
Oct 30 20:30:15.485315 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.485282    6015 scope.go:122] "RemoveContainer" containerID="53b79ab491819f8264a54e127f6ee538a3faaa6e8a73ed1714b6fa7263caf349"
Oct 30 20:30:15.485821 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.485784    6015 scope.go:122] "RemoveContainer" containerID="fc2ddce3002c0d6e4abf8cfbc5d479e5d66ab420ee6a9057edab31b26acc3c5a"
Oct 30 20:30:15.487291 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:15.487236    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk_odh-ai-gateway-infra(36907f92-2260-448b-a669-ea1c00e4ac15)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk" podUID="36907f92-2260-448b-a669-ea1c00e4ac15"
Oct 30 20:30:15.488142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.488116    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj" event={"ID":"b65972dd-bdcc-49fe-87ee-1d7068021ef5","Type":"ContainerStarted","Data":"2d09f88747e3f5a7661a635411d168e235dfb7cc9ef25157de1d2101e0e42e68"}
Oct 30 20:30:15.490241 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.490204    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b" event={"ID":"0ff662ee-f1de-4fd2-be9e-025803572c30","Type":"ContainerStarted","Data":"b4d8b9fd186780e5cf7be2e707e42d1df91686a3c4bbfb3969e183eae751aaac"}
Oct 30 20:30:15.492670 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.492643    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq" event={"ID":"a83151a2-417d-4c71-88d0-504e0871b155","Type":"ContainerStarted","Data":"1447c9cc4d7424ec55b9a79beba875bc94fd2f97dd21dbdffe4b5ffe28e4525e"}
Oct 30 20:30:15.545701 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.545664    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"]
Oct 30 20:30:15.597828 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:15.595394    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"]
Oct 30 20:30:16.502295 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.502256    6015 generic.go:356] "Generic (PLEG): container finished" podID="a83151a2-417d-4c71-88d0-504e0871b155" containerID="1447c9cc4d7424ec55b9a79beba875bc94fd2f97dd21dbdffe4b5ffe28e4525e" exitCode=60
Oct 30 20:30:16.502498 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.502333    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq" event={"ID":"a83151a2-417d-4c71-88d0-504e0871b155","Type":"ContainerDied","Data":"1447c9cc4d7424ec55b9a79beba875bc94fd2f97dd21dbdffe4b5ffe28e4525e"}
Oct 30 20:30:16.502498 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.502438    6015 scope.go:122] "RemoveContainer" containerID="fb90c0a9d0602cd6761461a7d0b042dbc62b45138717c93d1c216a48c8b0e600"
Oct 30 20:30:16.502903 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.502880    6015 scope.go:122] "RemoveContainer" containerID="1447c9cc4d7424ec55b9a79beba875bc94fd2f97dd21dbdffe4b5ffe28e4525e"
Oct 30 20:30:16.503277 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:16.503251    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq_odh-ai-gateway-infra(a83151a2-417d-4c71-88d0-504e0871b155)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq" podUID="a83151a2-417d-4c71-88d0-504e0871b155"
Oct 30 20:30:16.506955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.506924    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6" event={"ID":"62efb92e-44a9-4959-afc8-206349712106","Type":"ContainerStarted","Data":"3a889b947834f3623929a2a3a63e7e868f532091f3494b66c4f98d04093707cb"}
Oct 30 20:30:16.507085 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.506981    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6" event={"ID":"62efb92e-44a9-4959-afc8-206349712106","Type":"ContainerStarted","Data":"f75c4c40e8377336752a61d9e01b204f36e353e7be49cc940ab0b8712ae7039a"}
Oct 30 20:30:16.509033 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.507800    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:30:16.510071 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.510048    6015 generic.go:356] "Generic (PLEG): container finished" podID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerID="2d09f88747e3f5a7661a635411d168e235dfb7cc9ef25157de1d2101e0e42e68" exitCode=60
Oct 30 20:30:16.510198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.510128    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj" event={"ID":"b65972dd-bdcc-49fe-87ee-1d7068021ef5","Type":"ContainerDied","Data":"2d09f88747e3f5a7661a635411d168e235dfb7cc9ef25157de1d2101e0e42e68"}
Oct 30 20:30:16.510630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.510609    6015 scope.go:122] "RemoveContainer" containerID="2d09f88747e3f5a7661a635411d168e235dfb7cc9ef25157de1d2101e0e42e68"
Oct 30 20:30:16.511018 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:16.510996    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj_odh-ai-gateway-infra(b65972dd-bdcc-49fe-87ee-1d7068021ef5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5"
Oct 30 20:30:16.512264 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.512229    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b" event={"ID":"0ff662ee-f1de-4fd2-be9e-025803572c30","Type":"ContainerStarted","Data":"ed628cbe328cb85d89f231ca906c627fd4d9c08c8f379dcbeb30969cf6bb687b"}
Oct 30 20:30:16.512914 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.512895    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:30:16.519730 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.519705    6015 scope.go:122] "RemoveContainer" containerID="b07edf8aa817f9795ce9d48edcc75460102ce10c3cfe1eba2603adf79286a0b8"
Oct 30 20:30:16.593546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.580527    6015 scope.go:122] "RemoveContainer" containerID="9c18aa4389006cb57cad78b135aa89c4d6b16a6fd9b0675961acf26c472b850b"
Oct 30 20:30:16.593546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.581473    6015 scope.go:122] "RemoveContainer" containerID="2aab4f6448874ea8942c6cb5b46830246fe3036054815fc87c1cf4fa42547c8d"
Oct 30 20:30:16.593546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.582191    6015 scope.go:122] "RemoveContainer" containerID="2388d688203e58f03c86814dff1ebe7539fccfc1e9e597c89ff83b2b412c1cc2"
Oct 30 20:30:16.593546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.582865    6015 scope.go:122] "RemoveContainer" containerID="18a364d9df0149b532d5f5b1dd7a1bfbac2ee0c2294bc6b537bcad866efe3eb9"
Oct 30 20:30:16.735254 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.735227    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"
Oct 30 20:30:16.774841 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.774719    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"]
Oct 30 20:30:16.864232 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.864196    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36907f92-2260-448b-a669-ea1c00e4ac15-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36907f92-2260-448b-a669-ea1c00e4ac15-maas-api-service-ca\") pod \"36907f92-2260-448b-a669-ea1c00e4ac15\" (UID: \"36907f92-2260-448b-a669-ea1c00e4ac15\") "
Oct 30 20:30:16.864421 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.864390    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36907f92-2260-448b-a669-ea1c00e4ac15-kube-api-access-mqnxv\" (UniqueName: \"kubernetes.io/projected/36907f92-2260-448b-a669-ea1c00e4ac15-kube-api-access-mqnxv\") pod \"36907f92-2260-448b-a669-ea1c00e4ac15\" (UID: \"36907f92-2260-448b-a669-ea1c00e4ac15\") "
Oct 30 20:30:16.864564 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.864540    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36907f92-2260-448b-a669-ea1c00e4ac15-maas-api-service-ca" pod "36907f92-2260-448b-a669-ea1c00e4ac15" (UID: "36907f92-2260-448b-a669-ea1c00e4ac15"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:30:16.864887 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.864867    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36907f92-2260-448b-a669-ea1c00e4ac15-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:16.869675 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.867762    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6" podStartSLOduration=2.867745558 podStartE2EDuration="2.867745558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:30:16.865961169 +0000 UTC m=+3879.408768436" watchObservedRunningTime="2026-10-30 20:30:16.867745558 +0000 UTC m=+3879.410552824"
Oct 30 20:30:16.871853 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.871783    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36907f92-2260-448b-a669-ea1c00e4ac15-kube-api-access-mqnxv" pod "36907f92-2260-448b-a669-ea1c00e4ac15" (UID: "36907f92-2260-448b-a669-ea1c00e4ac15"). InnerVolumeSpecName "kube-api-access-mqnxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:30:16.880684 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.880648    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"]
Oct 30 20:30:16.966563 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:16.966528    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqnxv\" (UniqueName: \"kubernetes.io/projected/36907f92-2260-448b-a669-ea1c00e4ac15-kube-api-access-mqnxv\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:17.101382 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:17.101324    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b" podStartSLOduration=3.10130785 podStartE2EDuration="3.10130785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:30:17.098568235 +0000 UTC m=+3879.641375514" watchObservedRunningTime="2026-10-30 20:30:17.10130785 +0000 UTC m=+3879.644115119"
Oct 30 20:30:17.523202 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:17.523106    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"
Oct 30 20:30:17.523202 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:17.523126    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk" event={"ID":"36907f92-2260-448b-a669-ea1c00e4ac15","Type":"ContainerDied","Data":"158aa8500913ea570022eb8b9af9105c15cc04ea901cea31aa1a43bcf6958257"}
Oct 30 20:30:17.523202 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:17.523193    6015 scope.go:122] "RemoveContainer" containerID="fc2ddce3002c0d6e4abf8cfbc5d479e5d66ab420ee6a9057edab31b26acc3c5a"
Oct 30 20:30:17.529274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:17.529241    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" event={"ID":"569ff3bf-3e70-4721-839f-81c1eed209ce","Type":"ContainerStarted","Data":"e20ea6eb30b282102c4006eea045c8fb8aca35a38b09d076a6fb8c607ff6eb76"}
Oct 30 20:30:17.533681 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:17.533059    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9" event={"ID":"91ee5770-80b5-4592-9831-162edf44ab5c","Type":"ContainerStarted","Data":"a616457ec85e5cd7bceee989e633005194d25d7285d681f8e2de5dd1836b05a0"}
Oct 30 20:30:17.538412 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:17.538385    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" event={"ID":"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045","Type":"ContainerStarted","Data":"22cc235e6162f392cf45e0f6684cecdf62953ecb859052e0ae82a1e018c124d6"}
Oct 30 20:30:17.540760 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:17.540733    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg" event={"ID":"790b5c5f-5091-4af7-9377-902d0382b983","Type":"ContainerStarted","Data":"ef20e416cc0a7a2fd407269364e992a18176e768d75d7085366b27e8b419fb8b"}
Oct 30 20:30:17.801670 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:17.801635    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"]
Oct 30 20:30:17.807568 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:17.807533    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w4-742ff8-29889870-5grgk"]
Oct 30 20:30:18.075189 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.075161    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"
Oct 30 20:30:18.080431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.080402    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"
Oct 30 20:30:18.215660 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.215624    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a83151a2-417d-4c71-88d0-504e0871b155-kube-api-access-cw8sb\" (UniqueName: \"kubernetes.io/projected/a83151a2-417d-4c71-88d0-504e0871b155-kube-api-access-cw8sb\") pod \"a83151a2-417d-4c71-88d0-504e0871b155\" (UID: \"a83151a2-417d-4c71-88d0-504e0871b155\") "
Oct 30 20:30:18.215892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.215722    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b65972dd-bdcc-49fe-87ee-1d7068021ef5-kube-api-access-f8g68\" (UniqueName: \"kubernetes.io/projected/b65972dd-bdcc-49fe-87ee-1d7068021ef5-kube-api-access-f8g68\") pod \"b65972dd-bdcc-49fe-87ee-1d7068021ef5\" (UID: \"b65972dd-bdcc-49fe-87ee-1d7068021ef5\") "
Oct 30 20:30:18.215892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.215868    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b65972dd-bdcc-49fe-87ee-1d7068021ef5-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65972dd-bdcc-49fe-87ee-1d7068021ef5-maas-api-service-ca\") pod \"b65972dd-bdcc-49fe-87ee-1d7068021ef5\" (UID: \"b65972dd-bdcc-49fe-87ee-1d7068021ef5\") "
Oct 30 20:30:18.216054 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.215942    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a83151a2-417d-4c71-88d0-504e0871b155-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a83151a2-417d-4c71-88d0-504e0871b155-maas-api-service-ca\") pod \"a83151a2-417d-4c71-88d0-504e0871b155\" (UID: \"a83151a2-417d-4c71-88d0-504e0871b155\") "
Oct 30 20:30:18.216270 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.216237    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b65972dd-bdcc-49fe-87ee-1d7068021ef5-maas-api-service-ca" pod "b65972dd-bdcc-49fe-87ee-1d7068021ef5" (UID: "b65972dd-bdcc-49fe-87ee-1d7068021ef5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:30:18.216407 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.216305    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a83151a2-417d-4c71-88d0-504e0871b155-maas-api-service-ca" pod "a83151a2-417d-4c71-88d0-504e0871b155" (UID: "a83151a2-417d-4c71-88d0-504e0871b155"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:30:18.216843 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.216823    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65972dd-bdcc-49fe-87ee-1d7068021ef5-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:18.216903 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.216851    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a83151a2-417d-4c71-88d0-504e0871b155-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:18.218228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.218200    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a83151a2-417d-4c71-88d0-504e0871b155-kube-api-access-cw8sb" pod "a83151a2-417d-4c71-88d0-504e0871b155" (UID: "a83151a2-417d-4c71-88d0-504e0871b155"). InnerVolumeSpecName "kube-api-access-cw8sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:30:18.218350 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.218248    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65972dd-bdcc-49fe-87ee-1d7068021ef5-kube-api-access-f8g68" pod "b65972dd-bdcc-49fe-87ee-1d7068021ef5" (UID: "b65972dd-bdcc-49fe-87ee-1d7068021ef5"). InnerVolumeSpecName "kube-api-access-f8g68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:30:18.318281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.318241    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw8sb\" (UniqueName: \"kubernetes.io/projected/a83151a2-417d-4c71-88d0-504e0871b155-kube-api-access-cw8sb\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:18.318281 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.318277    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8g68\" (UniqueName: \"kubernetes.io/projected/b65972dd-bdcc-49fe-87ee-1d7068021ef5-kube-api-access-f8g68\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:18.564945 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.564907    6015 generic.go:356] "Generic (PLEG): container finished" podID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerID="e20ea6eb30b282102c4006eea045c8fb8aca35a38b09d076a6fb8c607ff6eb76" exitCode=60
Oct 30 20:30:18.565135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.564981    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" event={"ID":"569ff3bf-3e70-4721-839f-81c1eed209ce","Type":"ContainerDied","Data":"e20ea6eb30b282102c4006eea045c8fb8aca35a38b09d076a6fb8c607ff6eb76"}
Oct 30 20:30:18.565135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.565083    6015 scope.go:122] "RemoveContainer" containerID="9c18aa4389006cb57cad78b135aa89c4d6b16a6fd9b0675961acf26c472b850b"
Oct 30 20:30:18.565531 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.565509    6015 scope.go:122] "RemoveContainer" containerID="e20ea6eb30b282102c4006eea045c8fb8aca35a38b09d076a6fb8c607ff6eb76"
Oct 30 20:30:18.565942 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:18.565903    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj_odh-ai-gateway-infra(569ff3bf-3e70-4721-839f-81c1eed209ce)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce"
Oct 30 20:30:18.568125 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.568104    6015 generic.go:356] "Generic (PLEG): container finished" podID="91ee5770-80b5-4592-9831-162edf44ab5c" containerID="a616457ec85e5cd7bceee989e633005194d25d7285d681f8e2de5dd1836b05a0" exitCode=60
Oct 30 20:30:18.568241 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.568161    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9" event={"ID":"91ee5770-80b5-4592-9831-162edf44ab5c","Type":"ContainerDied","Data":"a616457ec85e5cd7bceee989e633005194d25d7285d681f8e2de5dd1836b05a0"}
Oct 30 20:30:18.568619 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.568601    6015 scope.go:122] "RemoveContainer" containerID="a616457ec85e5cd7bceee989e633005194d25d7285d681f8e2de5dd1836b05a0"
Oct 30 20:30:18.569020 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:18.568993    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9_odh-ai-gateway-infra(91ee5770-80b5-4592-9831-162edf44ab5c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9" podUID="91ee5770-80b5-4592-9831-162edf44ab5c"
Oct 30 20:30:18.569845 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.569823    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"
Oct 30 20:30:18.569966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.569832    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq" event={"ID":"a83151a2-417d-4c71-88d0-504e0871b155","Type":"ContainerDied","Data":"1c7cd2047d65274585714bd3ba34ac59c8c5fde7f45dc2d39b9058f0bb3a02aa"}
Oct 30 20:30:18.572001 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.571974    6015 generic.go:356] "Generic (PLEG): container finished" podID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerID="22cc235e6162f392cf45e0f6684cecdf62953ecb859052e0ae82a1e018c124d6" exitCode=60
Oct 30 20:30:18.572113 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.572051    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" event={"ID":"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045","Type":"ContainerDied","Data":"22cc235e6162f392cf45e0f6684cecdf62953ecb859052e0ae82a1e018c124d6"}
Oct 30 20:30:18.572452 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.572432    6015 scope.go:122] "RemoveContainer" containerID="22cc235e6162f392cf45e0f6684cecdf62953ecb859052e0ae82a1e018c124d6"
Oct 30 20:30:18.572765 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:18.572741    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7_odh-ai-gateway-infra(a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045"
Oct 30 20:30:18.575063 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.575042    6015 generic.go:356] "Generic (PLEG): container finished" podID="790b5c5f-5091-4af7-9377-902d0382b983" containerID="ef20e416cc0a7a2fd407269364e992a18176e768d75d7085366b27e8b419fb8b" exitCode=60
Oct 30 20:30:18.575151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.575116    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg" event={"ID":"790b5c5f-5091-4af7-9377-902d0382b983","Type":"ContainerDied","Data":"ef20e416cc0a7a2fd407269364e992a18176e768d75d7085366b27e8b419fb8b"}
Oct 30 20:30:18.575504 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.575486    6015 scope.go:122] "RemoveContainer" containerID="ef20e416cc0a7a2fd407269364e992a18176e768d75d7085366b27e8b419fb8b"
Oct 30 20:30:18.575824 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:18.575783    6015 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg_odh-ai-gateway-infra(790b5c5f-5091-4af7-9377-902d0382b983)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg" podUID="790b5c5f-5091-4af7-9377-902d0382b983"
Oct 30 20:30:18.584796 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.584771    6015 scope.go:122] "RemoveContainer" containerID="2aab4f6448874ea8942c6cb5b46830246fe3036054815fc87c1cf4fa42547c8d"
Oct 30 20:30:18.588593 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.588565    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"
Oct 30 20:30:18.588777 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.588755    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj" event={"ID":"b65972dd-bdcc-49fe-87ee-1d7068021ef5","Type":"ContainerDied","Data":"7b33360eeedf756e99027bf198aec1ccd5c9a0f34336378c83d63ef9a4f0045b"}
Oct 30 20:30:18.611355 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.611329    6015 scope.go:122] "RemoveContainer" containerID="1447c9cc4d7424ec55b9a79beba875bc94fd2f97dd21dbdffe4b5ffe28e4525e"
Oct 30 20:30:18.623308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.623285    6015 scope.go:122] "RemoveContainer" containerID="2388d688203e58f03c86814dff1ebe7539fccfc1e9e597c89ff83b2b412c1cc2"
Oct 30 20:30:18.637372 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.637346    6015 scope.go:122] "RemoveContainer" containerID="18a364d9df0149b532d5f5b1dd7a1bfbac2ee0c2294bc6b537bcad866efe3eb9"
Oct 30 20:30:18.651446 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.651421    6015 scope.go:122] "RemoveContainer" containerID="2d09f88747e3f5a7661a635411d168e235dfb7cc9ef25157de1d2101e0e42e68"
Oct 30 20:30:18.708031 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:18.707997    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"]
Oct 30 20:30:19.034558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.034444    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"]
Oct 30 20:30:19.146555 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.146520    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"]
Oct 30 20:30:19.190439 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.190403    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"]
Oct 30 20:30:19.196602 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.196563    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-4ec609-29889870-jlksj"]
Oct 30 20:30:19.302454 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.302299    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"]
Oct 30 20:30:19.307624 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.307590    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-bbfa07-29889870-8cllq"]
Oct 30 20:30:19.368769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.368731    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"]
Oct 30 20:30:19.591535 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.591444    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36907f92-2260-448b-a669-ea1c00e4ac15" path="/var/lib/kubelet/pods/36907f92-2260-448b-a669-ea1c00e4ac15/volumes"
Oct 30 20:30:19.592151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.592132    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a83151a2-417d-4c71-88d0-504e0871b155" path="/var/lib/kubelet/pods/a83151a2-417d-4c71-88d0-504e0871b155/volumes"
Oct 30 20:30:19.592682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.592664    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" path="/var/lib/kubelet/pods/b65972dd-bdcc-49fe-87ee-1d7068021ef5/volumes"
Oct 30 20:30:19.892862 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.892339    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"
Oct 30 20:30:19.898041 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.898016    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"
Oct 30 20:30:19.902859 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.902799    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"
Oct 30 20:30:19.929023 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:19.928993    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"
Oct 30 20:30:20.046537 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.046497    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-maas-api-service-ca\") pod \"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045\" (UID: \"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045\") "
Oct 30 20:30:20.047104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.046621    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/790b5c5f-5091-4af7-9377-902d0382b983-kube-api-access-68dgj\" (UniqueName: \"kubernetes.io/projected/790b5c5f-5091-4af7-9377-902d0382b983-kube-api-access-68dgj\") pod \"790b5c5f-5091-4af7-9377-902d0382b983\" (UID: \"790b5c5f-5091-4af7-9377-902d0382b983\") "
Oct 30 20:30:20.047104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.046708    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/91ee5770-80b5-4592-9831-162edf44ab5c-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91ee5770-80b5-4592-9831-162edf44ab5c-maas-api-service-ca\") pod \"91ee5770-80b5-4592-9831-162edf44ab5c\" (UID: \"91ee5770-80b5-4592-9831-162edf44ab5c\") "
Oct 30 20:30:20.047104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.046756    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/569ff3bf-3e70-4721-839f-81c1eed209ce-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/569ff3bf-3e70-4721-839f-81c1eed209ce-maas-api-service-ca\") pod \"569ff3bf-3e70-4721-839f-81c1eed209ce\" (UID: \"569ff3bf-3e70-4721-839f-81c1eed209ce\") "
Oct 30 20:30:20.047104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.046792    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/91ee5770-80b5-4592-9831-162edf44ab5c-kube-api-access-7b7z9\" (UniqueName: \"kubernetes.io/projected/91ee5770-80b5-4592-9831-162edf44ab5c-kube-api-access-7b7z9\") pod \"91ee5770-80b5-4592-9831-162edf44ab5c\" (UID: \"91ee5770-80b5-4592-9831-162edf44ab5c\") "
Oct 30 20:30:20.047104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.046903    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/790b5c5f-5091-4af7-9377-902d0382b983-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790b5c5f-5091-4af7-9377-902d0382b983-maas-api-service-ca\") pod \"790b5c5f-5091-4af7-9377-902d0382b983\" (UID: \"790b5c5f-5091-4af7-9377-902d0382b983\") "
Oct 30 20:30:20.047104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.046974    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-kube-api-access-8hgd7\" (UniqueName: \"kubernetes.io/projected/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-kube-api-access-8hgd7\") pod \"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045\" (UID: \"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045\") "
Oct 30 20:30:20.047104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.047052    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/569ff3bf-3e70-4721-839f-81c1eed209ce-kube-api-access-wm7zt\" (UniqueName: \"kubernetes.io/projected/569ff3bf-3e70-4721-839f-81c1eed209ce-kube-api-access-wm7zt\") pod \"569ff3bf-3e70-4721-839f-81c1eed209ce\" (UID: \"569ff3bf-3e70-4721-839f-81c1eed209ce\") "
Oct 30 20:30:20.047449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.047045    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-maas-api-service-ca" pod "a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" (UID: "a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:30:20.047449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.047139    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ee5770-80b5-4592-9831-162edf44ab5c-maas-api-service-ca" pod "91ee5770-80b5-4592-9831-162edf44ab5c" (UID: "91ee5770-80b5-4592-9831-162edf44ab5c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:30:20.047449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.047171    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/569ff3bf-3e70-4721-839f-81c1eed209ce-maas-api-service-ca" pod "569ff3bf-3e70-4721-839f-81c1eed209ce" (UID: "569ff3bf-3e70-4721-839f-81c1eed209ce"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:30:20.047603 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.047502    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790b5c5f-5091-4af7-9377-902d0382b983-maas-api-service-ca" pod "790b5c5f-5091-4af7-9377-902d0382b983" (UID: "790b5c5f-5091-4af7-9377-902d0382b983"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:30:20.047679 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.047661    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:20.047729 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.047684    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91ee5770-80b5-4592-9831-162edf44ab5c-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:20.047729 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.047694    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/569ff3bf-3e70-4721-839f-81c1eed209ce-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:20.047729 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.047703    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790b5c5f-5091-4af7-9377-902d0382b983-maas-api-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:20.049793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.049767    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/569ff3bf-3e70-4721-839f-81c1eed209ce-kube-api-access-wm7zt" pod "569ff3bf-3e70-4721-839f-81c1eed209ce" (UID: "569ff3bf-3e70-4721-839f-81c1eed209ce"). InnerVolumeSpecName "kube-api-access-wm7zt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:30:20.049921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.049821    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/790b5c5f-5091-4af7-9377-902d0382b983-kube-api-access-68dgj" pod "790b5c5f-5091-4af7-9377-902d0382b983" (UID: "790b5c5f-5091-4af7-9377-902d0382b983"). InnerVolumeSpecName "kube-api-access-68dgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:30:20.049921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.049890    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-kube-api-access-8hgd7" pod "a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" (UID: "a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045"). InnerVolumeSpecName "kube-api-access-8hgd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:30:20.049921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.049893    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ee5770-80b5-4592-9831-162edf44ab5c-kube-api-access-7b7z9" pod "91ee5770-80b5-4592-9831-162edf44ab5c" (UID: "91ee5770-80b5-4592-9831-162edf44ab5c"). InnerVolumeSpecName "kube-api-access-7b7z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:30:20.061179 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.061146    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:20.149109 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.149011    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm7zt\" (UniqueName: \"kubernetes.io/projected/569ff3bf-3e70-4721-839f-81c1eed209ce-kube-api-access-wm7zt\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:20.149109 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.149053    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68dgj\" (UniqueName: \"kubernetes.io/projected/790b5c5f-5091-4af7-9377-902d0382b983-kube-api-access-68dgj\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:20.149109 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.149062    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b7z9\" (UniqueName: \"kubernetes.io/projected/91ee5770-80b5-4592-9831-162edf44ab5c-kube-api-access-7b7z9\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:20.149109 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.149071    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hgd7\" (UniqueName: \"kubernetes.io/projected/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045-kube-api-access-8hgd7\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:30:20.623746 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.623710    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"
Oct 30 20:30:20.623746 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.623734    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj" event={"ID":"569ff3bf-3e70-4721-839f-81c1eed209ce","Type":"ContainerDied","Data":"9629bedb46f10102be71f7149d6de1bb6b56c25c45a0f53d9fccdf27ccf2eb4d"}
Oct 30 20:30:20.624040 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.623838    6015 scope.go:122] "RemoveContainer" containerID="e20ea6eb30b282102c4006eea045c8fb8aca35a38b09d076a6fb8c607ff6eb76"
Oct 30 20:30:20.625711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.625687    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"
Oct 30 20:30:20.625867 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.625701    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9" event={"ID":"91ee5770-80b5-4592-9831-162edf44ab5c","Type":"ContainerDied","Data":"8a0d8bac07f637673d0a1a1caf6107a867c7f1345d32770465cd59ccffcba41d"}
Oct 30 20:30:20.628293 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.628274    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"
Oct 30 20:30:20.628490 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.628275    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7" event={"ID":"a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045","Type":"ContainerDied","Data":"b7063f385d215bac3509c84fd921789334782323d5f83741941956e3f25ab8df"}
Oct 30 20:30:20.629982 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.629962    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"
Oct 30 20:30:20.630088 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.629964    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg" event={"ID":"790b5c5f-5091-4af7-9377-902d0382b983","Type":"ContainerDied","Data":"a9022760bf74b416ef11165e4a5a7cf44d7ead42d861266ee578fe6c5c14eef7"}
Oct 30 20:30:20.638388 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.638366    6015 scope.go:122] "RemoveContainer" containerID="a616457ec85e5cd7bceee989e633005194d25d7285d681f8e2de5dd1836b05a0"
Oct 30 20:30:20.650527 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.649844    6015 scope.go:122] "RemoveContainer" containerID="22cc235e6162f392cf45e0f6684cecdf62953ecb859052e0ae82a1e018c124d6"
Oct 30 20:30:20.659820 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.659784    6015 scope.go:122] "RemoveContainer" containerID="ef20e416cc0a7a2fd407269364e992a18176e768d75d7085366b27e8b419fb8b"
Oct 30 20:30:20.787495 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.787446    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"]
Oct 30 20:30:20.792723 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.792686    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-98a19b-29889870-7c7kj"]
Oct 30 20:30:20.898399 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.898306    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"]
Oct 30 20:30:20.903513 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:20.903479    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-547082-29889870-d7qkg"]
Oct 30 20:30:21.010376 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:21.010338    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"]
Oct 30 20:30:21.015305 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:21.015268    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-fe49e7-29889870-xhgb9"]
Oct 30 20:30:21.119868 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:21.119829    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"]
Oct 30 20:30:21.125419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:21.125391    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a74d15-29889870-mhmp7"]
Oct 30 20:30:21.588488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:21.588451    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce" path="/var/lib/kubelet/pods/569ff3bf-3e70-4721-839f-81c1eed209ce/volumes"
Oct 30 20:30:21.588990 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:21.588964    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="790b5c5f-5091-4af7-9377-902d0382b983" path="/var/lib/kubelet/pods/790b5c5f-5091-4af7-9377-902d0382b983/volumes"
Oct 30 20:30:21.589471 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:21.589444    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="91ee5770-80b5-4592-9831-162edf44ab5c" path="/var/lib/kubelet/pods/91ee5770-80b5-4592-9831-162edf44ab5c/volumes"
Oct 30 20:30:21.590182 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:21.590167    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" path="/var/lib/kubelet/pods/a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045/volumes"
Oct 30 20:30:25.265556 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:25.265522    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:28.217522 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:28.217477    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:30:28.592255 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:28.592218    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:30:28.592441 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:28.592311    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:30:30.154588 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:30.154537    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:30.324587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:30.324552    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:30.479782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:30.479678    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:35.289500 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:35.289465    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:38.639334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:38.639282    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:38.794162 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:38.794106    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:40.221855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:40.221814    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:40.411492 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:40.411447    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:40.570364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:40.570326    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:45.485984 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:45.485939    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:50.501076 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:50.501025    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:55.477798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:30:55.477751    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:30:58.219481 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:30:58.219438    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:31:00.584976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:00.584936    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:01.294919 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:01.294871    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:05.608109 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:05.608016    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:07.806188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:07.806147    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:08.038709 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:08.038665    6015 generic.go:356] "Generic (PLEG): container finished" podID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerID="7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc" exitCode=0
Oct 30 20:31:08.039004 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:08.038766    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" event={"ID":"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5","Type":"ContainerDied","Data":"7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc"}
Oct 30 20:31:08.039285 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:08.039263    6015 scope.go:122] "RemoveContainer" containerID="7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc"
Oct 30 20:31:08.041309 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:08.041275    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:31:08.041426 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:08.041352    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:31:08.041426 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:08.041386    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:31:08.759960 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:08.759874    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 30 20:31:08.759960 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:08.759923    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 30 20:31:09.047594 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.047557    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" event={"ID":"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5","Type":"ContainerStarted","Data":"d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7"}
Oct 30 20:31:09.049644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.049618    6015 generic.go:356] "Generic (PLEG): container finished" podID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerID="21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906" exitCode=0
Oct 30 20:31:09.049783 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.049660    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" event={"ID":"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1","Type":"ContainerDied","Data":"21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906"}
Oct 30 20:31:09.050096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.050079    6015 scope.go:122] "RemoveContainer" containerID="21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906"
Oct 30 20:31:09.051684 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.051654    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:31:09.051749 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.051727    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:31:09.051799 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.051780    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:31:09.136950 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.136911    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:09.880832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.879960    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:31:09.880832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.880106    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 30 20:31:09.880832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.880152    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 30 20:31:09.940236 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:09.940196    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:10.059751 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:10.059708    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" event={"ID":"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1","Type":"ContainerStarted","Data":"b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2"}
Oct 30 20:31:10.118854 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:10.118406    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:10.499832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:10.498305    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:31:10.499832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:10.498449    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 30 20:31:10.499832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:10.498495    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 30 20:31:10.886830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:10.885923    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:31:10.887074 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:10.887002    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 30 20:31:10.887074 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:10.887059    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 30 20:31:11.221893 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:11.221736    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:11.499092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:11.498996    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 30 20:31:11.500456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:11.500419    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 30 20:31:11.884588 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:11.884547    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 30 20:31:11.884944 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:11.884911    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 30 20:31:12.493788 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:12.493307    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 30 20:31:12.493788 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:12.493379    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 30 20:31:12.879282 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:12.879240    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 30 20:31:12.879592 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:12.879558    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 30 20:31:13.494832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:13.494312    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 30 20:31:13.494832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:13.494400    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 30 20:31:13.884838 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:13.882210    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused" start-of-body=
Oct 30 20:31:13.884838 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:13.882285    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.155:15021/healthz/ready\": dial tcp 10.134.0.155:15021: connect: connection refused"
Oct 30 20:31:14.315757 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:14.315496    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:14.495985 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:14.495940    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 30 20:31:14.496619 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:14.496577    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 30 20:31:14.498871 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:14.498845    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:14.660564 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:14.660456    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:14.892192 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:14.892154    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:31:14.894427 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:14.894393    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:31:15.492341 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:15.492289    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused" start-of-body=
Oct 30 20:31:15.492671 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:15.492626    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.154:15021/healthz/ready\": dial tcp 10.134.0.154:15021: connect: connection refused"
Oct 30 20:31:16.497470 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:16.497435    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:31:16.497875 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:16.497835    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:31:16.498531 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:16.498511    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:31:16.629129 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:16.629093    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:18.866538 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:18.866498    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:19.140657 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.140564    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:19.292593 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.292560    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"]
Oct 30 20:31:19.293218 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293203    6015 cpu_manager.go:414] "containerMap: removing container" podUID="36907f92-2260-448b-a669-ea1c00e4ac15" containerName="cleanup"
Oct 30 20:31:19.293271 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293221    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36907f92-2260-448b-a669-ea1c00e4ac15" containerName="cleanup"
Oct 30 20:31:19.293271 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293237    6015 cpu_manager.go:414] "containerMap: removing container" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerName="cleanup"
Oct 30 20:31:19.293271 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293243    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerName="cleanup"
Oct 30 20:31:19.293271 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293250    6015 cpu_manager.go:414] "containerMap: removing container" podUID="91ee5770-80b5-4592-9831-162edf44ab5c" containerName="cleanup"
Oct 30 20:31:19.293271 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293255    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="91ee5770-80b5-4592-9831-162edf44ab5c" containerName="cleanup"
Oct 30 20:31:19.293271 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293262    6015 cpu_manager.go:414] "containerMap: removing container" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerName="cleanup"
Oct 30 20:31:19.293271 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293267    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerName="cleanup"
Oct 30 20:31:19.293271 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293274    6015 cpu_manager.go:414] "containerMap: removing container" podUID="91ee5770-80b5-4592-9831-162edf44ab5c" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293278    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="91ee5770-80b5-4592-9831-162edf44ab5c" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293284    6015 cpu_manager.go:414] "containerMap: removing container" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293289    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293298    6015 cpu_manager.go:414] "containerMap: removing container" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293305    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293317    6015 cpu_manager.go:414] "containerMap: removing container" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293323    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293337    6015 cpu_manager.go:414] "containerMap: removing container" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293343    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293360    6015 cpu_manager.go:414] "containerMap: removing container" podUID="a83151a2-417d-4c71-88d0-504e0871b155" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293369    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a83151a2-417d-4c71-88d0-504e0871b155" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293380    6015 cpu_manager.go:414] "containerMap: removing container" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293387    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293395    6015 cpu_manager.go:414] "containerMap: removing container" podUID="a83151a2-417d-4c71-88d0-504e0871b155" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293400    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a83151a2-417d-4c71-88d0-504e0871b155" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293405    6015 cpu_manager.go:414] "containerMap: removing container" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293409    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293425    6015 cpu_manager.go:414] "containerMap: removing container" podUID="790b5c5f-5091-4af7-9377-902d0382b983" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293430    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="790b5c5f-5091-4af7-9377-902d0382b983" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293436    6015 cpu_manager.go:414] "containerMap: removing container" podUID="790b5c5f-5091-4af7-9377-902d0382b983" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293441    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="790b5c5f-5091-4af7-9377-902d0382b983" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293456    6015 cpu_manager.go:414] "containerMap: removing container" podUID="a83151a2-417d-4c71-88d0-504e0871b155" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293460    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a83151a2-417d-4c71-88d0-504e0871b155" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293471    6015 cpu_manager.go:414] "containerMap: removing container" podUID="36907f92-2260-448b-a669-ea1c00e4ac15" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293476    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36907f92-2260-448b-a669-ea1c00e4ac15" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293483    6015 cpu_manager.go:414] "containerMap: removing container" podUID="790b5c5f-5091-4af7-9377-902d0382b983" containerName="cleanup"
Oct 30 20:31:19.293551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293487    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="790b5c5f-5091-4af7-9377-902d0382b983" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293593    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="790b5c5f-5091-4af7-9377-902d0382b983" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293604    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="790b5c5f-5091-4af7-9377-902d0382b983" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293615    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="91ee5770-80b5-4592-9831-162edf44ab5c" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293624    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="a83151a2-417d-4c71-88d0-504e0871b155" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293628    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="36907f92-2260-448b-a669-ea1c00e4ac15" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293634    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293640    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="36907f92-2260-448b-a669-ea1c00e4ac15" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293646    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="790b5c5f-5091-4af7-9377-902d0382b983" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293655    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="36907f92-2260-448b-a669-ea1c00e4ac15" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293661    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293667    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293673    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="91ee5770-80b5-4592-9831-162edf44ab5c" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293680    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293686    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293692    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293697    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293703    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="a83151a2-417d-4c71-88d0-504e0871b155" containerName="cleanup"
Oct 30 20:31:19.294481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.293708    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="569ff3bf-3e70-4721-839f-81c1eed209ce" containerName="cleanup"
Oct 30 20:31:19.296433 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.296415    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:31:19.352556 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.352524    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"]
Oct 30 20:31:19.395525 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.395370    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-b-e391de\""
Oct 30 20:31:19.395525 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.395395    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-b-e391de-dockercfg-9twxr\""
Oct 30 20:31:19.441283 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.441246    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpqhn\" (UniqueName: \"kubernetes.io/projected/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-kube-api-access-lpqhn\") pod \"payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7\" (UID: \"831a6d20-0dfb-489e-9a03-f5cdc918fe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:31:19.444836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.441743    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7\" (UID: \"831a6d20-0dfb-489e-9a03-f5cdc918fe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:31:19.455836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.455352    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"]
Oct 30 20:31:19.459832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.456328    6015 cpu_manager.go:414] "containerMap: removing container" podUID="91ee5770-80b5-4592-9831-162edf44ab5c" containerName="cleanup"
Oct 30 20:31:19.459832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.456355    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="91ee5770-80b5-4592-9831-162edf44ab5c" containerName="cleanup"
Oct 30 20:31:19.459832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.456371    6015 cpu_manager.go:414] "containerMap: removing container" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerName="cleanup"
Oct 30 20:31:19.459832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.456379    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b65972dd-bdcc-49fe-87ee-1d7068021ef5" containerName="cleanup"
Oct 30 20:31:19.459832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.456474    6015 cpu_manager.go:414] "containerMap: removing container" podUID="36907f92-2260-448b-a669-ea1c00e4ac15" containerName="cleanup"
Oct 30 20:31:19.459832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.456482    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36907f92-2260-448b-a669-ea1c00e4ac15" containerName="cleanup"
Oct 30 20:31:19.459832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.456611    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9af3ea9-c8e8-4fcf-b87e-b4ffe7a47045" containerName="cleanup"
Oct 30 20:31:19.459832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.456629    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="91ee5770-80b5-4592-9831-162edf44ab5c" containerName="cleanup"
Oct 30 20:31:19.459832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.456639    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="a83151a2-417d-4c71-88d0-504e0871b155" containerName="cleanup"
Oct 30 20:31:19.462565 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.462538    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:31:19.523270 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.523232    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"]
Oct 30 20:31:19.552019 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.551970    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5v7z\" (UniqueName: \"kubernetes.io/projected/78e13f3d-4713-4a95-8110-42d51d2ca7ee-kube-api-access-w5v7z\") pod \"payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx\" (UID: \"78e13f3d-4713-4a95-8110-42d51d2ca7ee\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:31:19.552237 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.552151    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpqhn\" (UniqueName: \"kubernetes.io/projected/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-kube-api-access-lpqhn\") pod \"payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7\" (UID: \"831a6d20-0dfb-489e-9a03-f5cdc918fe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:31:19.552395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.552242    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7\" (UID: \"831a6d20-0dfb-489e-9a03-f5cdc918fe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:31:19.552395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.552313    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78e13f3d-4713-4a95-8110-42d51d2ca7ee-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx\" (UID: \"78e13f3d-4713-4a95-8110-42d51d2ca7ee\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:31:19.553128 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.553105    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7\" (UID: \"831a6d20-0dfb-489e-9a03-f5cdc918fe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:31:19.612696 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.612658    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpqhn\" (UniqueName: \"kubernetes.io/projected/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-kube-api-access-lpqhn\") pod \"payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7\" (UID: \"831a6d20-0dfb-489e-9a03-f5cdc918fe9d\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:31:19.653977 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.653886    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78e13f3d-4713-4a95-8110-42d51d2ca7ee-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx\" (UID: \"78e13f3d-4713-4a95-8110-42d51d2ca7ee\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:31:19.654180 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.654016    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5v7z\" (UniqueName: \"kubernetes.io/projected/78e13f3d-4713-4a95-8110-42d51d2ca7ee-kube-api-access-w5v7z\") pod \"payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx\" (UID: \"78e13f3d-4713-4a95-8110-42d51d2ca7ee\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:31:19.654625 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.654602    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78e13f3d-4713-4a95-8110-42d51d2ca7ee-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx\" (UID: \"78e13f3d-4713-4a95-8110-42d51d2ca7ee\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:31:19.713143 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.713113    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5v7z\" (UniqueName: \"kubernetes.io/projected/78e13f3d-4713-4a95-8110-42d51d2ca7ee-kube-api-access-w5v7z\") pod \"payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx\" (UID: \"78e13f3d-4713-4a95-8110-42d51d2ca7ee\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:31:19.789173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.789130    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:31:19.910117 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:19.910025    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:31:20.177028 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:20.176838    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"]
Oct 30 20:31:20.181039 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:31:20.181009    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e13f3d_4713_4a95_8110_42d51d2ca7ee.slice/crio-7216810c0d1ec0a601b0ac9460e03a18bf58441c1d4867a2e407e50fb5d70e2d WatchSource:0}: Error finding container 7216810c0d1ec0a601b0ac9460e03a18bf58441c1d4867a2e407e50fb5d70e2d: Status 404 returned error can't find the container with id 7216810c0d1ec0a601b0ac9460e03a18bf58441c1d4867a2e407e50fb5d70e2d
Oct 30 20:31:20.208434 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:20.208397    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx" event={"ID":"78e13f3d-4713-4a95-8110-42d51d2ca7ee","Type":"ContainerStarted","Data":"7216810c0d1ec0a601b0ac9460e03a18bf58441c1d4867a2e407e50fb5d70e2d"}
Oct 30 20:31:20.295570 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:20.295526    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"]
Oct 30 20:31:20.301060 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:31:20.301020    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831a6d20_0dfb_489e_9a03_f5cdc918fe9d.slice/crio-e6a9fee8c5369b48bb9f63c4e500a514cc2945e376137f259618ea46770c5a16 WatchSource:0}: Error finding container e6a9fee8c5369b48bb9f63c4e500a514cc2945e376137f259618ea46770c5a16: Status 404 returned error can't find the container with id e6a9fee8c5369b48bb9f63c4e500a514cc2945e376137f259618ea46770c5a16
Oct 30 20:31:21.216880 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:21.216841    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx" event={"ID":"78e13f3d-4713-4a95-8110-42d51d2ca7ee","Type":"ContainerStarted","Data":"aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99"}
Oct 30 20:31:21.217402 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:21.216951    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:31:21.218532 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:21.218507    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7" event={"ID":"831a6d20-0dfb-489e-9a03-f5cdc918fe9d","Type":"ContainerStarted","Data":"e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d"}
Oct 30 20:31:21.218656 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:21.218547    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7" event={"ID":"831a6d20-0dfb-489e-9a03-f5cdc918fe9d","Type":"ContainerStarted","Data":"e6a9fee8c5369b48bb9f63c4e500a514cc2945e376137f259618ea46770c5a16"}
Oct 30 20:31:21.218656 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:21.218568    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:31:21.330364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:21.330305    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx" podStartSLOduration=2.330289257 podStartE2EDuration="2.330289257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:31:21.328738896 +0000 UTC m=+3943.871546161" watchObservedRunningTime="2026-10-30 20:31:21.330289257 +0000 UTC m=+3943.873096521"
Oct 30 20:31:21.446917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:21.443704    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7" podStartSLOduration=2.443682136 podStartE2EDuration="2.443682136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:31:21.441526945 +0000 UTC m=+3943.984334210" watchObservedRunningTime="2026-10-30 20:31:21.443682136 +0000 UTC m=+3943.986489404"
Oct 30 20:31:22.113521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:22.113491    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:27.496644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:27.496607    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:28.218353 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:31:28.218315    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:31:32.228413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:32.228383    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:31:32.228851 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:32.228510    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:31:32.497274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:32.497180    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:37.512791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:37.512728    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:42.508175 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:42.508129    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:47.528354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:47.528263    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:52.443656 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:52.443619    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:52.619203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:52.619150    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:52.778861 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:52.778718    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:57.816471 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:31:57.816427    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:31:58.216420 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:31:58.216341    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:32:01.642620 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:01.642579    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:02.898058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:02.898013    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:03.813501 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:03.813458    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:04.017584 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:04.017538    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:08.104240 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:08.104201    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:08.904830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:08.904765    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:09.362141 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:09.362101    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:13.068490 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:13.068444    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:18.246669 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:18.246629    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"]
Oct 30 20:32:18.313744 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:18.313708    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:18.630357 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:18.630325    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:18.782436 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:18.782395    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:23.246968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.246919    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq" podUID="1a8925a4-5ca5-487c-bbf6-b820e636eda1" containerName="payload-processing" containerID="cri-o://27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9" gracePeriod=25
Oct 30 20:32:23.530419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.530387    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:32:23.624179 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.624118    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a8925a4-5ca5-487c-bbf6-b820e636eda1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8925a4-5ca5-487c-bbf6-b820e636eda1-plugins-config-volume\") pod \"1a8925a4-5ca5-487c-bbf6-b820e636eda1\" (UID: \"1a8925a4-5ca5-487c-bbf6-b820e636eda1\") "
Oct 30 20:32:23.624371 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.624330    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a8925a4-5ca5-487c-bbf6-b820e636eda1-kube-api-access-qw4n6\" (UniqueName: \"kubernetes.io/projected/1a8925a4-5ca5-487c-bbf6-b820e636eda1-kube-api-access-qw4n6\") pod \"1a8925a4-5ca5-487c-bbf6-b820e636eda1\" (UID: \"1a8925a4-5ca5-487c-bbf6-b820e636eda1\") "
Oct 30 20:32:23.624550 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.624521    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8925a4-5ca5-487c-bbf6-b820e636eda1-plugins-config-volume" pod "1a8925a4-5ca5-487c-bbf6-b820e636eda1" (UID: "1a8925a4-5ca5-487c-bbf6-b820e636eda1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:32:23.625090 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.625020    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8925a4-5ca5-487c-bbf6-b820e636eda1-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:32:23.626689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.626663    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a8925a4-5ca5-487c-bbf6-b820e636eda1-kube-api-access-qw4n6" pod "1a8925a4-5ca5-487c-bbf6-b820e636eda1" (UID: "1a8925a4-5ca5-487c-bbf6-b820e636eda1"). InnerVolumeSpecName "kube-api-access-qw4n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:32:23.673905 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.673865    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:23.688234 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.688176    6015 generic.go:356] "Generic (PLEG): container finished" podID="1a8925a4-5ca5-487c-bbf6-b820e636eda1" containerID="27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9" exitCode=0
Oct 30 20:32:23.688234 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.688230    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"
Oct 30 20:32:23.688469 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.688257    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq" event={"ID":"1a8925a4-5ca5-487c-bbf6-b820e636eda1","Type":"ContainerDied","Data":"27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9"}
Oct 30 20:32:23.688469 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.688311    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq" event={"ID":"1a8925a4-5ca5-487c-bbf6-b820e636eda1","Type":"ContainerDied","Data":"03528a4e8973762b7b8c757655589c48158e4c7bd389d8b7e0a219fc4dd996f7"}
Oct 30 20:32:23.688469 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.688337    6015 scope.go:122] "RemoveContainer" containerID="27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9"
Oct 30 20:32:23.727016 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.726979    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw4n6\" (UniqueName: \"kubernetes.io/projected/1a8925a4-5ca5-487c-bbf6-b820e636eda1-kube-api-access-qw4n6\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:32:23.736425 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.736393    6015 scope.go:122] "RemoveContainer" containerID="27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9"
Oct 30 20:32:23.737040 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:32:23.737001    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9\": container with ID starting with 27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9 not found: ID does not exist" containerID="27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9"
Oct 30 20:32:23.737183 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.737049    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9"} err="failed to get container status \"27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9\": rpc error: code = NotFound desc = could not find container \"27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9\": container with ID starting with 27a8cb4e86f85b8c8e7924e148c84baa77971882a52df7207c9a5606e73bb0b9 not found: ID does not exist"
Oct 30 20:32:23.847184 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.847144    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"]
Oct 30 20:32:23.851494 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:23.851461    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-8d612c-594697bf6-t47vq"]
Oct 30 20:32:25.589778 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:25.589746    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a8925a4-5ca5-487c-bbf6-b820e636eda1" path="/var/lib/kubelet/pods/1a8925a4-5ca5-487c-bbf6-b820e636eda1/volumes"
Oct 30 20:32:28.227258 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:32:28.227206    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:32:28.760439 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:28.760390    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:30.825316 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:30.825280    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"]
Oct 30 20:32:30.934275 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:30.934235    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"]
Oct 30 20:32:31.332217 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:31.332177    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:31.533210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:31.533174    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:34.255979 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:34.255939    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:35.826557 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:35.826491    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr" podUID="5ff2e779-97b8-4c85-8883-0a643fbcc30d" containerName="payload-processing" containerID="cri-o://e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e" gracePeriod=25
Oct 30 20:32:35.934594 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:35.934547    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6" podUID="013f02fc-ceea-4ecd-a959-8ff18321bffb" containerName="payload-pre-processing" containerID="cri-o://eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff" gracePeriod=25
Oct 30 20:32:36.136780 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.136736    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:32:36.196443 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.196409    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ff2e779-97b8-4c85-8883-0a643fbcc30d-kube-api-access-kmqzr\" (UniqueName: \"kubernetes.io/projected/5ff2e779-97b8-4c85-8883-0a643fbcc30d-kube-api-access-kmqzr\") pod \"5ff2e779-97b8-4c85-8883-0a643fbcc30d\" (UID: \"5ff2e779-97b8-4c85-8883-0a643fbcc30d\") "
Oct 30 20:32:36.196613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.196503    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ff2e779-97b8-4c85-8883-0a643fbcc30d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ff2e779-97b8-4c85-8883-0a643fbcc30d-plugins-config-volume\") pod \"5ff2e779-97b8-4c85-8883-0a643fbcc30d\" (UID: \"5ff2e779-97b8-4c85-8883-0a643fbcc30d\") "
Oct 30 20:32:36.196992 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.196952    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ff2e779-97b8-4c85-8883-0a643fbcc30d-plugins-config-volume" pod "5ff2e779-97b8-4c85-8883-0a643fbcc30d" (UID: "5ff2e779-97b8-4c85-8883-0a643fbcc30d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:32:36.197122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.197094    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ff2e779-97b8-4c85-8883-0a643fbcc30d-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:32:36.198771 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.198753    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:32:36.198877 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.198859    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ff2e779-97b8-4c85-8883-0a643fbcc30d-kube-api-access-kmqzr" pod "5ff2e779-97b8-4c85-8883-0a643fbcc30d" (UID: "5ff2e779-97b8-4c85-8883-0a643fbcc30d"). InnerVolumeSpecName "kube-api-access-kmqzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:32:36.297765 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.297730    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/013f02fc-ceea-4ecd-a959-8ff18321bffb-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/013f02fc-ceea-4ecd-a959-8ff18321bffb-plugins-config-volume\") pod \"013f02fc-ceea-4ecd-a959-8ff18321bffb\" (UID: \"013f02fc-ceea-4ecd-a959-8ff18321bffb\") "
Oct 30 20:32:36.297765 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.297771    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/013f02fc-ceea-4ecd-a959-8ff18321bffb-kube-api-access-q5bwf\" (UniqueName: \"kubernetes.io/projected/013f02fc-ceea-4ecd-a959-8ff18321bffb-kube-api-access-q5bwf\") pod \"013f02fc-ceea-4ecd-a959-8ff18321bffb\" (UID: \"013f02fc-ceea-4ecd-a959-8ff18321bffb\") "
Oct 30 20:32:36.298216 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.298183    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/013f02fc-ceea-4ecd-a959-8ff18321bffb-plugins-config-volume" pod "013f02fc-ceea-4ecd-a959-8ff18321bffb" (UID: "013f02fc-ceea-4ecd-a959-8ff18321bffb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:32:36.298358 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.298341    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmqzr\" (UniqueName: \"kubernetes.io/projected/5ff2e779-97b8-4c85-8883-0a643fbcc30d-kube-api-access-kmqzr\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:32:36.298420 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.298364    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/013f02fc-ceea-4ecd-a959-8ff18321bffb-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:32:36.300175 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.300151    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/013f02fc-ceea-4ecd-a959-8ff18321bffb-kube-api-access-q5bwf" pod "013f02fc-ceea-4ecd-a959-8ff18321bffb" (UID: "013f02fc-ceea-4ecd-a959-8ff18321bffb"). InnerVolumeSpecName "kube-api-access-q5bwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:32:36.400209 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.400114    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5bwf\" (UniqueName: \"kubernetes.io/projected/013f02fc-ceea-4ecd-a959-8ff18321bffb-kube-api-access-q5bwf\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:32:36.778303 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.778201    6015 generic.go:356] "Generic (PLEG): container finished" podID="013f02fc-ceea-4ecd-a959-8ff18321bffb" containerID="eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff" exitCode=0
Oct 30 20:32:36.778303 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.778261    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"
Oct 30 20:32:36.778536 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.778301    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6" event={"ID":"013f02fc-ceea-4ecd-a959-8ff18321bffb","Type":"ContainerDied","Data":"eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff"}
Oct 30 20:32:36.778536 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.778360    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6" event={"ID":"013f02fc-ceea-4ecd-a959-8ff18321bffb","Type":"ContainerDied","Data":"955dc4ee324c4fa7684561079ab8f544537d247f3a8f4e5d5e0756faf1400382"}
Oct 30 20:32:36.778536 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.778385    6015 scope.go:122] "RemoveContainer" containerID="eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff"
Oct 30 20:32:36.779976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.779956    6015 generic.go:356] "Generic (PLEG): container finished" podID="5ff2e779-97b8-4c85-8883-0a643fbcc30d" containerID="e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e" exitCode=0
Oct 30 20:32:36.780078 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.780020    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr" event={"ID":"5ff2e779-97b8-4c85-8883-0a643fbcc30d","Type":"ContainerDied","Data":"e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e"}
Oct 30 20:32:36.780140 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.780076    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr" event={"ID":"5ff2e779-97b8-4c85-8883-0a643fbcc30d","Type":"ContainerDied","Data":"d9369fceedf185faa3d1e07ab932336880b43285935b32a32c59411677927fda"}
Oct 30 20:32:36.780206 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.780189    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"
Oct 30 20:32:36.791027 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.791007    6015 scope.go:122] "RemoveContainer" containerID="eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff"
Oct 30 20:32:36.791327 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:32:36.791309    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff\": container with ID starting with eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff not found: ID does not exist" containerID="eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff"
Oct 30 20:32:36.791403 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.791335    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff"} err="failed to get container status \"eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff\": rpc error: code = NotFound desc = could not find container \"eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff\": container with ID starting with eee809dd98747b6fc454a29ff21b19cf35826be63ef7a8ffc0e821539c8a2aff not found: ID does not exist"
Oct 30 20:32:36.791403 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.791353    6015 scope.go:122] "RemoveContainer" containerID="e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e"
Oct 30 20:32:36.802608 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.802575    6015 scope.go:122] "RemoveContainer" containerID="e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e"
Oct 30 20:32:36.802986 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:32:36.802962    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e\": container with ID starting with e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e not found: ID does not exist" containerID="e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e"
Oct 30 20:32:36.803070 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.802997    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e"} err="failed to get container status \"e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e\": rpc error: code = NotFound desc = could not find container \"e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e\": container with ID starting with e3979edaaf65c5131322d1dbab09435569b61adf15b0c3de7ef4d7c492f87c3e not found: ID does not exist"
Oct 30 20:32:36.935616 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.935570    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"]
Oct 30 20:32:36.983451 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:36.983412    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w4-742ff8-f9cbd45bb-hjjcr"]
Oct 30 20:32:37.045446 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:37.045417    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"]
Oct 30 20:32:37.051459 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:37.051426    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-742ff8-85756b6547-7fcs6"]
Oct 30 20:32:37.589129 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:37.589097    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="013f02fc-ceea-4ecd-a959-8ff18321bffb" path="/var/lib/kubelet/pods/013f02fc-ceea-4ecd-a959-8ff18321bffb/volumes"
Oct 30 20:32:37.589561 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:37.589547    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ff2e779-97b8-4c85-8883-0a643fbcc30d" path="/var/lib/kubelet/pods/5ff2e779-97b8-4c85-8883-0a643fbcc30d/volumes"
Oct 30 20:32:39.595354 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:39.595317    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:44.601726 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:44.601687    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:49.584700 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:49.584661    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:54.706744 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:54.706695    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:58.216381 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:32:58.216344    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:32:59.687201 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:59.687159    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:32:59.836781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:32:59.836735    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:00.012044 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:00.011956    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:02.014166 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:02.014105    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:04.842044 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:04.842006    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:09.790849 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:09.790789    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:10.340720 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.340679    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"]
Oct 30 20:33:10.341369 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.341347    6015 cpu_manager.go:414] "containerMap: removing container" podUID="5ff2e779-97b8-4c85-8883-0a643fbcc30d" containerName="payload-processing"
Oct 30 20:33:10.341369 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.341367    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ff2e779-97b8-4c85-8883-0a643fbcc30d" containerName="payload-processing"
Oct 30 20:33:10.341529 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.341388    6015 cpu_manager.go:414] "containerMap: removing container" podUID="1a8925a4-5ca5-487c-bbf6-b820e636eda1" containerName="payload-processing"
Oct 30 20:33:10.341529 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.341394    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a8925a4-5ca5-487c-bbf6-b820e636eda1" containerName="payload-processing"
Oct 30 20:33:10.341529 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.341430    6015 cpu_manager.go:414] "containerMap: removing container" podUID="013f02fc-ceea-4ecd-a959-8ff18321bffb" containerName="payload-pre-processing"
Oct 30 20:33:10.341529 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.341435    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="013f02fc-ceea-4ecd-a959-8ff18321bffb" containerName="payload-pre-processing"
Oct 30 20:33:10.341663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.341531    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ff2e779-97b8-4c85-8883-0a643fbcc30d" containerName="payload-processing"
Oct 30 20:33:10.341663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.341543    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a8925a4-5ca5-487c-bbf6-b820e636eda1" containerName="payload-processing"
Oct 30 20:33:10.341663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.341553    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="013f02fc-ceea-4ecd-a959-8ff18321bffb" containerName="payload-pre-processing"
Oct 30 20:33:10.344036 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.344020    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:10.393870 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.393830    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:33:10.440773 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.440735    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kmwqm\""
Oct 30 20:33:10.443498 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.443473    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"]
Oct 30 20:33:10.460728 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.460698    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-autores-79c649-jsj5w\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:10.460891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.460741    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njk5k\" (UniqueName: \"kubernetes.io/projected/345984e1-9a48-4c09-82d7-de83fc531e1b-kube-api-access-njk5k\") pod \"maas-api-revoke-keys-e2e-autores-79c649-jsj5w\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:10.460891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.460862    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-autores-79c649-jsj5w\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:10.562297 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.562261    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-autores-79c649-jsj5w\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:10.562515 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.562432    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-autores-79c649-jsj5w\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:10.562515 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.562466    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njk5k\" (UniqueName: \"kubernetes.io/projected/345984e1-9a48-4c09-82d7-de83fc531e1b-kube-api-access-njk5k\") pod \"maas-api-revoke-keys-e2e-autores-79c649-jsj5w\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:10.563088 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.563067    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-autores-79c649-jsj5w\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:10.564913 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.564881    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-autores-79c649-jsj5w\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:10.621580 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.621505    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njk5k\" (UniqueName: \"kubernetes.io/projected/345984e1-9a48-4c09-82d7-de83fc531e1b-kube-api-access-njk5k\") pod \"maas-api-revoke-keys-e2e-autores-79c649-jsj5w\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:10.657417 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:10.657380    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:11.041484 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:11.041360    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"]
Oct 30 20:33:11.046771 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:33:11.046730    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345984e1_9a48_4c09_82d7_de83fc531e1b.slice/crio-3474e13b7fdad89f5dacbf712ebfbc44afa31e612b85f2c1cb0c064b96e396b9 WatchSource:0}: Error finding container 3474e13b7fdad89f5dacbf712ebfbc44afa31e612b85f2c1cb0c064b96e396b9: Status 404 returned error can't find the container with id 3474e13b7fdad89f5dacbf712ebfbc44afa31e612b85f2c1cb0c064b96e396b9
Oct 30 20:33:12.037850 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:12.037781    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w" event={"ID":"345984e1-9a48-4c09-82d7-de83fc531e1b","Type":"ContainerStarted","Data":"cdb6c70d4ec6c71a2cdc16253c388ca17c366d098a60075222fcc884f6f46cd7"}
Oct 30 20:33:12.038036 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:12.037876    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w" event={"ID":"345984e1-9a48-4c09-82d7-de83fc531e1b","Type":"ContainerStarted","Data":"3474e13b7fdad89f5dacbf712ebfbc44afa31e612b85f2c1cb0c064b96e396b9"}
Oct 30 20:33:12.151726 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:12.151661    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w" podStartSLOduration=2.151644917 podStartE2EDuration="2.151644917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:33:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:33:12.149220562 +0000 UTC m=+4054.692027828" watchObservedRunningTime="2026-10-30 20:33:12.151644917 +0000 UTC m=+4054.694452193"
Oct 30 20:33:13.045936 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:13.045898    6015 generic.go:356] "Generic (PLEG): container finished" podID="345984e1-9a48-4c09-82d7-de83fc531e1b" containerID="cdb6c70d4ec6c71a2cdc16253c388ca17c366d098a60075222fcc884f6f46cd7" exitCode=0
Oct 30 20:33:13.046125 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:13.045991    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w" event={"ID":"345984e1-9a48-4c09-82d7-de83fc531e1b","Type":"ContainerDied","Data":"cdb6c70d4ec6c71a2cdc16253c388ca17c366d098a60075222fcc884f6f46cd7"}
Oct 30 20:33:14.231404 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:14.231374    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:14.415210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:14.415104    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/345984e1-9a48-4c09-82d7-de83fc531e1b-kube-api-access-njk5k\" (UniqueName: \"kubernetes.io/projected/345984e1-9a48-4c09-82d7-de83fc531e1b-kube-api-access-njk5k\") pod \"345984e1-9a48-4c09-82d7-de83fc531e1b\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") "
Oct 30 20:33:14.415401 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:14.415292    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-openshift-ca\") pod \"345984e1-9a48-4c09-82d7-de83fc531e1b\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") "
Oct 30 20:33:14.415401 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:14.415326    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-xks-ca\") pod \"345984e1-9a48-4c09-82d7-de83fc531e1b\" (UID: \"345984e1-9a48-4c09-82d7-de83fc531e1b\") "
Oct 30 20:33:14.415683 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:14.415661    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-openshift-ca" pod "345984e1-9a48-4c09-82d7-de83fc531e1b" (UID: "345984e1-9a48-4c09-82d7-de83fc531e1b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:33:14.415872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:14.415858    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-openshift-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:14.417665 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:14.417638    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-xks-ca" pod "345984e1-9a48-4c09-82d7-de83fc531e1b" (UID: "345984e1-9a48-4c09-82d7-de83fc531e1b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:33:14.417781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:14.417732    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/345984e1-9a48-4c09-82d7-de83fc531e1b-kube-api-access-njk5k" pod "345984e1-9a48-4c09-82d7-de83fc531e1b" (UID: "345984e1-9a48-4c09-82d7-de83fc531e1b"). InnerVolumeSpecName "kube-api-access-njk5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:33:14.517588 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:14.517544    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njk5k\" (UniqueName: \"kubernetes.io/projected/345984e1-9a48-4c09-82d7-de83fc531e1b-kube-api-access-njk5k\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:14.517588 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:14.517581    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/345984e1-9a48-4c09-82d7-de83fc531e1b-maas-api-xks-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:15.062912 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:15.062877    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"
Oct 30 20:33:15.062912 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:15.062901    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w" event={"ID":"345984e1-9a48-4c09-82d7-de83fc531e1b","Type":"ContainerDied","Data":"3474e13b7fdad89f5dacbf712ebfbc44afa31e612b85f2c1cb0c064b96e396b9"}
Oct 30 20:33:15.063177 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:15.062965    6015 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3474e13b7fdad89f5dacbf712ebfbc44afa31e612b85f2c1cb0c064b96e396b9"
Oct 30 20:33:15.088445 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:33:15.088413    6015 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345984e1_9a48_4c09_82d7_de83fc531e1b.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 20:33:15.288957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:15.288914    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:20.387450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:20.387367    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:21.884310 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:21.884222    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"]
Oct 30 20:33:21.993870 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:21.993830    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"]
Oct 30 20:33:22.261982 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:22.261886    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:22.417352 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:22.417310    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:25.528393 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:25.528343    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:26.885736 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:26.885684    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6" podUID="62efb92e-44a9-4959-afc8-206349712106" containerName="payload-processing" containerID="cri-o://3a889b947834f3623929a2a3a63e7e868f532091f3494b66c4f98d04093707cb" gracePeriod=25
Oct 30 20:33:26.994873 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:26.994749    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b" podUID="0ff662ee-f1de-4fd2-be9e-025803572c30" containerName="payload-pre-processing" containerID="cri-o://ed628cbe328cb85d89f231ca906c627fd4d9c08c8f379dcbeb30969cf6bb687b" gracePeriod=25
Oct 30 20:33:27.157655 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.157624    6015 generic.go:356] "Generic (PLEG): container finished" podID="62efb92e-44a9-4959-afc8-206349712106" containerID="3a889b947834f3623929a2a3a63e7e868f532091f3494b66c4f98d04093707cb" exitCode=0
Oct 30 20:33:27.157897 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.157709    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6" event={"ID":"62efb92e-44a9-4959-afc8-206349712106","Type":"ContainerDied","Data":"3a889b947834f3623929a2a3a63e7e868f532091f3494b66c4f98d04093707cb"}
Oct 30 20:33:27.157897 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.157747    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6" event={"ID":"62efb92e-44a9-4959-afc8-206349712106","Type":"ContainerDied","Data":"f75c4c40e8377336752a61d9e01b204f36e353e7be49cc940ab0b8712ae7039a"}
Oct 30 20:33:27.157897 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.157765    6015 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f75c4c40e8377336752a61d9e01b204f36e353e7be49cc940ab0b8712ae7039a"
Oct 30 20:33:27.159791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.159771    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:33:27.159922 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.159839    6015 generic.go:356] "Generic (PLEG): container finished" podID="0ff662ee-f1de-4fd2-be9e-025803572c30" containerID="ed628cbe328cb85d89f231ca906c627fd4d9c08c8f379dcbeb30969cf6bb687b" exitCode=0
Oct 30 20:33:27.159982 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.159956    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b" event={"ID":"0ff662ee-f1de-4fd2-be9e-025803572c30","Type":"ContainerDied","Data":"ed628cbe328cb85d89f231ca906c627fd4d9c08c8f379dcbeb30969cf6bb687b"}
Oct 30 20:33:27.260731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.260706    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:33:27.288514 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.288468    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62efb92e-44a9-4959-afc8-206349712106-kube-api-access-jzr87\" (UniqueName: \"kubernetes.io/projected/62efb92e-44a9-4959-afc8-206349712106-kube-api-access-jzr87\") pod \"62efb92e-44a9-4959-afc8-206349712106\" (UID: \"62efb92e-44a9-4959-afc8-206349712106\") "
Oct 30 20:33:27.288726 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.288567    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62efb92e-44a9-4959-afc8-206349712106-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62efb92e-44a9-4959-afc8-206349712106-plugins-config-volume\") pod \"62efb92e-44a9-4959-afc8-206349712106\" (UID: \"62efb92e-44a9-4959-afc8-206349712106\") "
Oct 30 20:33:27.290568 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.290531    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62efb92e-44a9-4959-afc8-206349712106-plugins-config-volume" pod "62efb92e-44a9-4959-afc8-206349712106" (UID: "62efb92e-44a9-4959-afc8-206349712106"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:33:27.292737 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.292706    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62efb92e-44a9-4959-afc8-206349712106-kube-api-access-jzr87" pod "62efb92e-44a9-4959-afc8-206349712106" (UID: "62efb92e-44a9-4959-afc8-206349712106"). InnerVolumeSpecName "kube-api-access-jzr87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:33:27.390896 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.390794    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ff662ee-f1de-4fd2-be9e-025803572c30-kube-api-access-ql5ck\" (UniqueName: \"kubernetes.io/projected/0ff662ee-f1de-4fd2-be9e-025803572c30-kube-api-access-ql5ck\") pod \"0ff662ee-f1de-4fd2-be9e-025803572c30\" (UID: \"0ff662ee-f1de-4fd2-be9e-025803572c30\") "
Oct 30 20:33:27.391082 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.390917    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ff662ee-f1de-4fd2-be9e-025803572c30-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ff662ee-f1de-4fd2-be9e-025803572c30-plugins-config-volume\") pod \"0ff662ee-f1de-4fd2-be9e-025803572c30\" (UID: \"0ff662ee-f1de-4fd2-be9e-025803572c30\") "
Oct 30 20:33:27.391290 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.391270    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzr87\" (UniqueName: \"kubernetes.io/projected/62efb92e-44a9-4959-afc8-206349712106-kube-api-access-jzr87\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:27.391290 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.391287    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62efb92e-44a9-4959-afc8-206349712106-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:27.391438 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.391367    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ff662ee-f1de-4fd2-be9e-025803572c30-plugins-config-volume" pod "0ff662ee-f1de-4fd2-be9e-025803572c30" (UID: "0ff662ee-f1de-4fd2-be9e-025803572c30"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:33:27.393748 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.393716    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ff662ee-f1de-4fd2-be9e-025803572c30-kube-api-access-ql5ck" pod "0ff662ee-f1de-4fd2-be9e-025803572c30" (UID: "0ff662ee-f1de-4fd2-be9e-025803572c30"). InnerVolumeSpecName "kube-api-access-ql5ck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:33:27.492245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.492203    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql5ck\" (UniqueName: \"kubernetes.io/projected/0ff662ee-f1de-4fd2-be9e-025803572c30-kube-api-access-ql5ck\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:27.492245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:27.492241    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ff662ee-f1de-4fd2-be9e-025803572c30-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:28.167857 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:28.167735    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"
Oct 30 20:33:28.167857 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:28.167748    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b" event={"ID":"0ff662ee-f1de-4fd2-be9e-025803572c30","Type":"ContainerDied","Data":"b4d8b9fd186780e5cf7be2e707e42d1df91686a3c4bbfb3969e183eae751aaac"}
Oct 30 20:33:28.167857 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:28.167831    6015 scope.go:122] "RemoveContainer" containerID="ed628cbe328cb85d89f231ca906c627fd4d9c08c8f379dcbeb30969cf6bb687b"
Oct 30 20:33:28.168470 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:28.168056    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"
Oct 30 20:33:28.217587 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:33:28.217545    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:33:28.325490 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:28.325459    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"]
Oct 30 20:33:28.373932 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:28.373895    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-79c649-7955c4d77f-wlm5b"]
Oct 30 20:33:28.432662 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:28.432580    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"]
Oct 30 20:33:28.437062 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:28.437029    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-79c649-5cf6767768-nl4l6"]
Oct 30 20:33:29.590239 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:29.590198    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ff662ee-f1de-4fd2-be9e-025803572c30" path="/var/lib/kubelet/pods/0ff662ee-f1de-4fd2-be9e-025803572c30/volumes"
Oct 30 20:33:29.590842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:29.590823    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62efb92e-44a9-4959-afc8-206349712106" path="/var/lib/kubelet/pods/62efb92e-44a9-4959-afc8-206349712106/volumes"
Oct 30 20:33:30.577018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:30.576974    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:35.567684 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:35.567642    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:39.982401 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:39.982360    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:41.181044 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:41.181004    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:41.568940 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:41.568897    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:41.886577 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:41.886470    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:42.206446 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:42.206344    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"]
Oct 30 20:33:42.253010 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:42.252970    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-79c649-jsj5w"]
Oct 30 20:33:42.634554 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:42.634512    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:42.823817 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:42.823780    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:43.095317 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:43.095272    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:43.247576 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:43.247539    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:43.587450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:43.587418    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="345984e1-9a48-4c09-82d7-de83fc531e1b" path="/var/lib/kubelet/pods/345984e1-9a48-4c09-82d7-de83fc531e1b/volumes"
Oct 30 20:33:43.758266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:43.758229    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:46.251839 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:46.251767    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:46.456363 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:46.456326    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:47.700891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:47.700851    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:48.929049 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:48.929017    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:49.311988 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:49.311943    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:49.717867 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:49.717743    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:49.883479 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:49.883408    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:50.084039 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:50.084001    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:50.302946 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:50.302892    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:50.615465 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:50.615398    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:50.778844 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:50.778787    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:50.949950 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:50.949681    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:50.976875 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:50.976835    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"]
Oct 30 20:33:50.977098 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:50.977072    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy" containerID="cri-o://b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2" gracePeriod=30
Oct 30 20:33:51.191432 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:51.191395    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:51.562431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:51.562381    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:51.909875 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:51.909778    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:52.597980 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.597940    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"]
Oct 30 20:33:52.598941 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.598921    6015 cpu_manager.go:414] "containerMap: removing container" podUID="0ff662ee-f1de-4fd2-be9e-025803572c30" containerName="payload-pre-processing"
Oct 30 20:33:52.599030 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.598943    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ff662ee-f1de-4fd2-be9e-025803572c30" containerName="payload-pre-processing"
Oct 30 20:33:52.599030 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.599004    6015 cpu_manager.go:414] "containerMap: removing container" podUID="62efb92e-44a9-4959-afc8-206349712106" containerName="payload-processing"
Oct 30 20:33:52.599030 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.599015    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62efb92e-44a9-4959-afc8-206349712106" containerName="payload-processing"
Oct 30 20:33:52.599127 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.599046    6015 cpu_manager.go:414] "containerMap: removing container" podUID="345984e1-9a48-4c09-82d7-de83fc531e1b" containerName="revoke-keys"
Oct 30 20:33:52.599127 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.599053    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="345984e1-9a48-4c09-82d7-de83fc531e1b" containerName="revoke-keys"
Oct 30 20:33:52.599218 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.599206    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ff662ee-f1de-4fd2-be9e-025803572c30" containerName="payload-pre-processing"
Oct 30 20:33:52.599253 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.599230    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="62efb92e-44a9-4959-afc8-206349712106" containerName="payload-processing"
Oct 30 20:33:52.599253 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.599241    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="345984e1-9a48-4c09-82d7-de83fc531e1b" containerName="revoke-keys"
Oct 30 20:33:52.602607 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.602587    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.657290 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.657254    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-a-46dadd-openshift-default-dockercfg-7ft25\""
Oct 30 20:33:52.698757 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.698709    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:52.704111 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.704075    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"]
Oct 30 20:33:52.755338 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.755301    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-podinfo\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.755732 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.755710    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d00166f-5e3a-416e-8b21-d5a30638c025-istiod-ca-cert\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.755908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.755883    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-envoy\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.756042 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.755938    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-credential-socket\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.756198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.756029    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-certs\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.756198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.756095    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-socket\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.756198 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.756163    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-data\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.756374 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.756230    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-token\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.756374 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.756306    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcn76\" (UniqueName: \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-kube-api-access-kcn76\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.857520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.857428    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-credential-socket\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.857520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.857471    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-certs\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.857785 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.857556    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-socket\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.857785 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.857605    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-data\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.857785 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.857654    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-token\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.857981 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.857781    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcn76\" (UniqueName: \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-kube-api-access-kcn76\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.857981 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.857863    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-podinfo\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.858092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.857999    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-certs\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.858092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.858011    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d00166f-5e3a-416e-8b21-d5a30638c025-istiod-ca-cert\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.858092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.858026    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-credential-socket\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.858306 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.858090    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-envoy\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.858306 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.858124    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-socket\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.858306 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.858281    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-data\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.858656 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.858632    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d00166f-5e3a-416e-8b21-d5a30638c025-istiod-ca-cert\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.860689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.860666    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-envoy\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.860795 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.860751    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-podinfo\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.917213 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.917165    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-token\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.917843 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.917789    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcn76\" (UniqueName: \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-kube-api-access-kcn76\") pod \"e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") " pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.927421 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.927389    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:52.992305 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:52.992198    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:53.175304 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.175195    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"]
Oct 30 20:33:53.179770 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.179743    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:53.230134 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.230089    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:33:53.230351 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.230206    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kmwqm\""
Oct 30 20:33:53.233439 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.233408    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"]
Oct 30 20:33:53.363364 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.363317    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:53.363558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.363398    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:53.363558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.363457    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv5vb\" (UniqueName: \"kubernetes.io/projected/a250e50e-ce45-4e3f-ae10-83048da01ad5-kube-api-access-qv5vb\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:53.382613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.382556    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"]
Oct 30 20:33:53.387427 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:33:53.387386    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d00166f_5e3a_416e_8b21_d5a30638c025.slice/crio-3510a672ff191082fca96a40d6758e8ce80a29c97d883c23ef54c356ecf8781f WatchSource:0}: Error finding container 3510a672ff191082fca96a40d6758e8ce80a29c97d883c23ef54c356ecf8781f: Status 404 returned error can't find the container with id 3510a672ff191082fca96a40d6758e8ce80a29c97d883c23ef54c356ecf8781f
Oct 30 20:33:53.390423 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.390385    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:33:53.390548 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.390459    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:33:53.390548 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.390510    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:33:53.464727 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.464698    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv5vb\" (UniqueName: \"kubernetes.io/projected/a250e50e-ce45-4e3f-ae10-83048da01ad5-kube-api-access-qv5vb\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:53.464966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.464946    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:53.465040 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.465008    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:53.465676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.465653    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:53.467977 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.467952    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:53.524011 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.523978    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv5vb\" (UniqueName: \"kubernetes.io/projected/a250e50e-ce45-4e3f-ae10-83048da01ad5-kube-api-access-qv5vb\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:53.796163 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:53.796127    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:54.176285 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:54.176189    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"]
Oct 30 20:33:54.182944 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:33:54.182914    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda250e50e_ce45_4e3f_ae10_83048da01ad5.slice/crio-532e9a5990c4dac6098081235fcc6dccb913081f26d4f44891f50e138df0a5d2 WatchSource:0}: Error finding container 532e9a5990c4dac6098081235fcc6dccb913081f26d4f44891f50e138df0a5d2: Status 404 returned error can't find the container with id 532e9a5990c4dac6098081235fcc6dccb913081f26d4f44891f50e138df0a5d2
Oct 30 20:33:54.350930 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:54.350894    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2" event={"ID":"a250e50e-ce45-4e3f-ae10-83048da01ad5","Type":"ContainerStarted","Data":"532e9a5990c4dac6098081235fcc6dccb913081f26d4f44891f50e138df0a5d2"}
Oct 30 20:33:54.352588 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:54.352561    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" event={"ID":"2d00166f-5e3a-416e-8b21-d5a30638c025","Type":"ContainerStarted","Data":"008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed"}
Oct 30 20:33:54.352754 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:54.352602    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" event={"ID":"2d00166f-5e3a-416e-8b21-d5a30638c025","Type":"ContainerStarted","Data":"3510a672ff191082fca96a40d6758e8ce80a29c97d883c23ef54c356ecf8781f"}
Oct 30 20:33:54.471248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:54.471177    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" podStartSLOduration=2.471153709 podStartE2EDuration="2.471153709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:33:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:33:54.468756427 +0000 UTC m=+4097.011563697" watchObservedRunningTime="2026-10-30 20:33:54.471153709 +0000 UTC m=+4097.013960975"
Oct 30 20:33:54.928108 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:54.928063    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:54.934310 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:54.934274    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:55.361258 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:55.361223    6015 generic.go:356] "Generic (PLEG): container finished" podID="a250e50e-ce45-4e3f-ae10-83048da01ad5" containerID="e3399ba8a1ad4871f5409ea9adbce801d9068854f5fc43fd26319c5fd384fad8" exitCode=0
Oct 30 20:33:55.361462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:55.361300    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2" event={"ID":"a250e50e-ce45-4e3f-ae10-83048da01ad5","Type":"ContainerDied","Data":"e3399ba8a1ad4871f5409ea9adbce801d9068854f5fc43fd26319c5fd384fad8"}
Oct 30 20:33:55.361748 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:55.361731    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:55.362700 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:55.362677    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:33:56.265594 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.265562    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:33:56.315131 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315095    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-socket\") pod \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") "
Oct 30 20:33:56.315308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315185    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-podinfo\") pod \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") "
Oct 30 20:33:56.315308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315274    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istiod-ca-cert\") pod \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") "
Oct 30 20:33:56.315308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315294    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-credential-socket\") pod \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") "
Oct 30 20:33:56.315512 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315406    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-socket" pod "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" (UID: "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:33:56.315512 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315429    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-data\") pod \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") "
Oct 30 20:33:56.315512 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315478    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-envoy\") pod \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") "
Oct 30 20:33:56.315685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315515    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-kube-api-access-64qpx\" (UniqueName: \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-kube-api-access-64qpx\") pod \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") "
Oct 30 20:33:56.315685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315584    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-credential-socket" pod "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" (UID: "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:33:56.315685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315639    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-token\" (UniqueName: \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-token\") pod \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") "
Oct 30 20:33:56.315685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315658    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-data" pod "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" (UID: "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:33:56.315949 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315699    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-certs\") pod \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\" (UID: \"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1\") "
Oct 30 20:33:56.315949 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.315710    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istiod-ca-cert" pod "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" (UID: "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:33:56.316309 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.316183    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-certs" pod "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" (UID: "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:33:56.316461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.316388    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.316461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.316410    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.316461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.316423    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.316461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.316435    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.316461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.316448    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.317955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.317922    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-kube-api-access-64qpx" pod "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" (UID: "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1"). InnerVolumeSpecName "kube-api-access-64qpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:33:56.318080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.317981    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-token" pod "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" (UID: "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:33:56.318340 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.318318    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-podinfo" pod "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" (UID: "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:33:56.318340 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.318333    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-envoy" pod "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" (UID: "1ecfa928-d746-41c3-a9b4-b962d2c2c6d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:33:56.354380 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.354344    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:56.372149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.372105    6015 generic.go:356] "Generic (PLEG): container finished" podID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerID="b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2" exitCode=0
Oct 30 20:33:56.372352 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.372154    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"
Oct 30 20:33:56.372352 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.372200    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" event={"ID":"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1","Type":"ContainerDied","Data":"b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2"}
Oct 30 20:33:56.372352 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.372266    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc" event={"ID":"1ecfa928-d746-41c3-a9b4-b962d2c2c6d1","Type":"ContainerDied","Data":"65139aca7acf3e270f3c6c6b6e14b4f93db80c94ff67376305e1b7f199bbec6e"}
Oct 30 20:33:56.372352 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.372298    6015 scope.go:122] "RemoveContainer" containerID="b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2"
Oct 30 20:33:56.408017 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.407986    6015 scope.go:122] "RemoveContainer" containerID="21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906"
Oct 30 20:33:56.418495 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.418464    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.418495 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.418498    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.418731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.418515    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64qpx\" (UniqueName: \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-kube-api-access-64qpx\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.418731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.418530    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.424240 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.424150    6015 scope.go:122] "RemoveContainer" containerID="b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2"
Oct 30 20:33:56.425228 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:33:56.424694    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2\": container with ID starting with b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2 not found: ID does not exist" containerID="b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2"
Oct 30 20:33:56.425228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.424739    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2"} err="failed to get container status \"b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2\": rpc error: code = NotFound desc = could not find container \"b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2\": container with ID starting with b5e43ab551c4c2413674a2a40a3a7db476b08061d6ae3dd9ffbc2ae26a6829b2 not found: ID does not exist"
Oct 30 20:33:56.425228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.424765    6015 scope.go:122] "RemoveContainer" containerID="21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906"
Oct 30 20:33:56.425921 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:33:56.425840    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906\": container with ID starting with 21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906 not found: ID does not exist" containerID="21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906"
Oct 30 20:33:56.425921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.425866    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906"} err="failed to get container status \"21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906\": rpc error: code = NotFound desc = could not find container \"21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906\": container with ID starting with 21747a6cd8743ece4b62e7ac91376046197743903c3e52274614af46cdc2a906 not found: ID does not exist"
Oct 30 20:33:56.552440 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.552413    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"]
Oct 30 20:33:56.559293 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.559254    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-a-9389b9-openshift-default-699f5c4f69-p64hc"]
Oct 30 20:33:56.576890 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.576840    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:56.621370 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.621333    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a250e50e-ce45-4e3f-ae10-83048da01ad5-kube-api-access-qv5vb\" (UniqueName: \"kubernetes.io/projected/a250e50e-ce45-4e3f-ae10-83048da01ad5-kube-api-access-qv5vb\") pod \"a250e50e-ce45-4e3f-ae10-83048da01ad5\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") "
Oct 30 20:33:56.621582 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.621389    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-openshift-ca\") pod \"a250e50e-ce45-4e3f-ae10-83048da01ad5\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") "
Oct 30 20:33:56.621663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.621594    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-xks-ca\") pod \"a250e50e-ce45-4e3f-ae10-83048da01ad5\" (UID: \"a250e50e-ce45-4e3f-ae10-83048da01ad5\") "
Oct 30 20:33:56.621921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.621892    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-openshift-ca" pod "a250e50e-ce45-4e3f-ae10-83048da01ad5" (UID: "a250e50e-ce45-4e3f-ae10-83048da01ad5"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:33:56.622177 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.622155    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-openshift-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.623916 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.623886    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-xks-ca" pod "a250e50e-ce45-4e3f-ae10-83048da01ad5" (UID: "a250e50e-ce45-4e3f-ae10-83048da01ad5"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:33:56.624149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.624134    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a250e50e-ce45-4e3f-ae10-83048da01ad5-kube-api-access-qv5vb" pod "a250e50e-ce45-4e3f-ae10-83048da01ad5" (UID: "a250e50e-ce45-4e3f-ae10-83048da01ad5"). InnerVolumeSpecName "kube-api-access-qv5vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:33:56.723255 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.723215    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a250e50e-ce45-4e3f-ae10-83048da01ad5-maas-api-xks-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.723255 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.723253    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv5vb\" (UniqueName: \"kubernetes.io/projected/a250e50e-ce45-4e3f-ae10-83048da01ad5-kube-api-access-qv5vb\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:33:56.938451 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:56.938413    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:57.155350 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:57.155310    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:57.386852 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:57.384685    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:57.396545 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:57.394859    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"
Oct 30 20:33:57.396545 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:57.394947    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2" event={"ID":"a250e50e-ce45-4e3f-ae10-83048da01ad5","Type":"ContainerDied","Data":"532e9a5990c4dac6098081235fcc6dccb913081f26d4f44891f50e138df0a5d2"}
Oct 30 20:33:57.396545 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:57.395061    6015 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="532e9a5990c4dac6098081235fcc6dccb913081f26d4f44891f50e138df0a5d2"
Oct 30 20:33:57.588604 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:57.588571    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" path="/var/lib/kubelet/pods/1ecfa928-d746-41c3-a9b4-b962d2c2c6d1/volumes"
Oct 30 20:33:57.663451 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:57.663412    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:58.147861 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.147820    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"]
Oct 30 20:33:58.148571 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.148553    6015 cpu_manager.go:414] "containerMap: removing container" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy"
Oct 30 20:33:58.148635 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.148572    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy"
Oct 30 20:33:58.148635 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.148621    6015 cpu_manager.go:414] "containerMap: removing container" podUID="a250e50e-ce45-4e3f-ae10-83048da01ad5" containerName="revoke-keys"
Oct 30 20:33:58.148635 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.148630    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a250e50e-ce45-4e3f-ae10-83048da01ad5" containerName="revoke-keys"
Oct 30 20:33:58.148754 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.148741    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy"
Oct 30 20:33:58.148799 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.148759    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="a250e50e-ce45-4e3f-ae10-83048da01ad5" containerName="revoke-keys"
Oct 30 20:33:58.151450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.151430    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:33:58.207851 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.207800    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"]
Oct 30 20:33:58.225552 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:33:58.225516    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:33:58.243531 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.243490    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:33:58.243699 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.243546    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw69h\" (UniqueName: \"kubernetes.io/projected/f267cd16-d777-4f24-b0b9-ba709966d733-kube-api-access-xw69h\") pod \"maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:33:58.243764 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.243739    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:33:58.250625 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.250589    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:33:58.250754 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.250699    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kmwqm\""
Oct 30 20:33:58.345583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.345541    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:33:58.345894 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.345593    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw69h\" (UniqueName: \"kubernetes.io/projected/f267cd16-d777-4f24-b0b9-ba709966d733-kube-api-access-xw69h\") pod \"maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:33:58.345894 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.345748    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:33:58.346434 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.346409    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:33:58.348574 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.348542    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:33:58.404884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.404763    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw69h\" (UniqueName: \"kubernetes.io/projected/f267cd16-d777-4f24-b0b9-ba709966d733-kube-api-access-xw69h\") pod \"maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:33:58.466107 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.466069    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:33:58.771513 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.771410    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:58.846197 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.846162    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"]
Oct 30 20:33:58.852433 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:33:58.852404    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf267cd16_d777_4f24_b0b9_ba709966d733.slice/crio-348859c844afcd9a457f433a2c0b24e6ca1b644cc402536c4f983f7fdb353c0d WatchSource:0}: Error finding container 348859c844afcd9a457f433a2c0b24e6ca1b644cc402536c4f983f7fdb353c0d: Status 404 returned error can't find the container with id 348859c844afcd9a457f433a2c0b24e6ca1b644cc402536c4f983f7fdb353c0d
Oct 30 20:33:58.976677 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:58.976640    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:59.150331 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:59.150285    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:33:59.413041 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:59.412938    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk" event={"ID":"f267cd16-d777-4f24-b0b9-ba709966d733","Type":"ContainerStarted","Data":"44ac89b71d051e424223c9ce7d19096844e4f445636139200d6df17cd891c0f1"}
Oct 30 20:33:59.413041 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:59.413030    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk" event={"ID":"f267cd16-d777-4f24-b0b9-ba709966d733","Type":"ContainerStarted","Data":"348859c844afcd9a457f433a2c0b24e6ca1b644cc402536c4f983f7fdb353c0d"}
Oct 30 20:33:59.525416 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:33:59.525363    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk" podStartSLOduration=1.525347323 podStartE2EDuration="1.525347323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:33:59.523356963 +0000 UTC m=+4102.066164229" watchObservedRunningTime="2026-10-30 20:33:59.525347323 +0000 UTC m=+4102.068154615"
Oct 30 20:34:00.420894 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:00.420860    6015 generic.go:356] "Generic (PLEG): container finished" podID="f267cd16-d777-4f24-b0b9-ba709966d733" containerID="44ac89b71d051e424223c9ce7d19096844e4f445636139200d6df17cd891c0f1" exitCode=0
Oct 30 20:34:00.421313 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:00.420947    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk" event={"ID":"f267cd16-d777-4f24-b0b9-ba709966d733","Type":"ContainerDied","Data":"44ac89b71d051e424223c9ce7d19096844e4f445636139200d6df17cd891c0f1"}
Oct 30 20:34:00.640255 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:00.640224    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:00.826105 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:00.826067    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:01.022636 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.022594    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"]
Oct 30 20:34:01.023340 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.023321    6015 cpu_manager.go:414] "containerMap: removing container" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy"
Oct 30 20:34:01.023443 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.023340    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy"
Oct 30 20:34:01.023500 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.023455    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ecfa928-d746-41c3-a9b4-b962d2c2c6d1" containerName="istio-proxy"
Oct 30 20:34:01.026102 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.026077    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:34:01.078592 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.078504    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-a-46dadd\""
Oct 30 20:34:01.082754 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.082705    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"]
Oct 30 20:34:01.089509 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.089471    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt\" (UID: \"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:34:01.089676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.089539    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5crlw\" (UniqueName: \"kubernetes.io/projected/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-kube-api-access-5crlw\") pod \"payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt\" (UID: \"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:34:01.165174 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.165120    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-a-46dadd-dockercfg-nxks5\""
Oct 30 20:34:01.203935 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.203890    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt\" (UID: \"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:34:01.204149 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.203960    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5crlw\" (UniqueName: \"kubernetes.io/projected/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-kube-api-access-5crlw\") pod \"payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt\" (UID: \"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:34:01.205195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.205158    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt\" (UID: \"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:34:01.211353 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.211324    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"]
Oct 30 20:34:01.215367 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.215346    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:34:01.264054 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.263999    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5crlw\" (UniqueName: \"kubernetes.io/projected/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-kube-api-access-5crlw\") pod \"payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt\" (UID: \"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:34:01.267185 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.267153    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"]
Oct 30 20:34:01.305381 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.305339    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8l67\" (UniqueName: \"kubernetes.io/projected/41370641-dd3b-4349-b909-64bec93bc378-kube-api-access-m8l67\") pod \"payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls\" (UID: \"41370641-dd3b-4349-b909-64bec93bc378\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:34:01.305588 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.305510    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41370641-dd3b-4349-b909-64bec93bc378-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls\" (UID: \"41370641-dd3b-4349-b909-64bec93bc378\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:34:01.342294 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.342201    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:34:01.414644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.407653    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8l67\" (UniqueName: \"kubernetes.io/projected/41370641-dd3b-4349-b909-64bec93bc378-kube-api-access-m8l67\") pod \"payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls\" (UID: \"41370641-dd3b-4349-b909-64bec93bc378\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:34:01.414644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.407796    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41370641-dd3b-4349-b909-64bec93bc378-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls\" (UID: \"41370641-dd3b-4349-b909-64bec93bc378\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:34:01.414644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.408874    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41370641-dd3b-4349-b909-64bec93bc378-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls\" (UID: \"41370641-dd3b-4349-b909-64bec93bc378\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:34:01.474870 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.474627    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8l67\" (UniqueName: \"kubernetes.io/projected/41370641-dd3b-4349-b909-64bec93bc378-kube-api-access-m8l67\") pod \"payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls\" (UID: \"41370641-dd3b-4349-b909-64bec93bc378\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:34:01.530941 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.530911    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:34:01.582773 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.582742    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:34:01.712573 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.712533    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f267cd16-d777-4f24-b0b9-ba709966d733-kube-api-access-xw69h\" (UniqueName: \"kubernetes.io/projected/f267cd16-d777-4f24-b0b9-ba709966d733-kube-api-access-xw69h\") pod \"f267cd16-d777-4f24-b0b9-ba709966d733\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") "
Oct 30 20:34:01.712843 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.712820    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-xks-ca\") pod \"f267cd16-d777-4f24-b0b9-ba709966d733\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") "
Oct 30 20:34:01.712925 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.712902    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-openshift-ca\") pod \"f267cd16-d777-4f24-b0b9-ba709966d733\" (UID: \"f267cd16-d777-4f24-b0b9-ba709966d733\") "
Oct 30 20:34:01.713320 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.713290    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-openshift-ca" pod "f267cd16-d777-4f24-b0b9-ba709966d733" (UID: "f267cd16-d777-4f24-b0b9-ba709966d733"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:34:01.713646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.713621    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-openshift-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:01.715673 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.715640    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f267cd16-d777-4f24-b0b9-ba709966d733-kube-api-access-xw69h" pod "f267cd16-d777-4f24-b0b9-ba709966d733" (UID: "f267cd16-d777-4f24-b0b9-ba709966d733"). InnerVolumeSpecName "kube-api-access-xw69h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:34:01.715855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.715787    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-xks-ca" pod "f267cd16-d777-4f24-b0b9-ba709966d733" (UID: "f267cd16-d777-4f24-b0b9-ba709966d733"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:34:01.726483 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.726446    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"]
Oct 30 20:34:01.732479 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:34:01.732449    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe73112_57a7_47e2_9a5e_3e2eb20e0c4c.slice/crio-0290d4aa76f507bc022307c397b23d6441caa5e7a8488d602080181754176e1f WatchSource:0}: Error finding container 0290d4aa76f507bc022307c397b23d6441caa5e7a8488d602080181754176e1f: Status 404 returned error can't find the container with id 0290d4aa76f507bc022307c397b23d6441caa5e7a8488d602080181754176e1f
Oct 30 20:34:01.814994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.814963    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw69h\" (UniqueName: \"kubernetes.io/projected/f267cd16-d777-4f24-b0b9-ba709966d733-kube-api-access-xw69h\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:01.814994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.814995    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f267cd16-d777-4f24-b0b9-ba709966d733-maas-api-xks-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:01.928298 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.928201    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"]
Oct 30 20:34:01.933906 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:34:01.933867    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41370641_dd3b_4349_b909_64bec93bc378.slice/crio-73da8b8f5f10aed84d2f6b245dabe6c334982f2d8168489c273671123b92c575 WatchSource:0}: Error finding container 73da8b8f5f10aed84d2f6b245dabe6c334982f2d8168489c273671123b92c575: Status 404 returned error can't find the container with id 73da8b8f5f10aed84d2f6b245dabe6c334982f2d8168489c273671123b92c575
Oct 30 20:34:01.983098 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:01.983063    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:02.392681 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.392642    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:02.438200 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.438168    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"
Oct 30 20:34:02.438396 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.438165    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk" event={"ID":"f267cd16-d777-4f24-b0b9-ba709966d733","Type":"ContainerDied","Data":"348859c844afcd9a457f433a2c0b24e6ca1b644cc402536c4f983f7fdb353c0d"}
Oct 30 20:34:02.438396 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.438303    6015 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="348859c844afcd9a457f433a2c0b24e6ca1b644cc402536c4f983f7fdb353c0d"
Oct 30 20:34:02.440056 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.440024    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls" event={"ID":"41370641-dd3b-4349-b909-64bec93bc378","Type":"ContainerStarted","Data":"f776c4b6994a1d4ff3bad68fd124cbdfcec3789ee00be823bbdce647545c7f24"}
Oct 30 20:34:02.440212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.440075    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls" event={"ID":"41370641-dd3b-4349-b909-64bec93bc378","Type":"ContainerStarted","Data":"73da8b8f5f10aed84d2f6b245dabe6c334982f2d8168489c273671123b92c575"}
Oct 30 20:34:02.440212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.440109    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:34:02.441682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.441659    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt" event={"ID":"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c","Type":"ContainerStarted","Data":"bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19"}
Oct 30 20:34:02.441792 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.441695    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt" event={"ID":"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c","Type":"ContainerStarted","Data":"0290d4aa76f507bc022307c397b23d6441caa5e7a8488d602080181754176e1f"}
Oct 30 20:34:02.441792 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.441713    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:34:02.564300 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.564241    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls" podStartSLOduration=1.564228291 podStartE2EDuration="1.564228291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:34:02.562365774 +0000 UTC m=+4105.105173041" watchObservedRunningTime="2026-10-30 20:34:02.564228291 +0000 UTC m=+4105.107035591"
Oct 30 20:34:02.730272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:02.730203    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt" podStartSLOduration=2.7301836440000002 podStartE2EDuration="2.730183644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:34:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:34:02.726980479 +0000 UTC m=+4105.269787748" watchObservedRunningTime="2026-10-30 20:34:02.730183644 +0000 UTC m=+4105.272990911"
Oct 30 20:34:05.800747 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:05.800707    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:05.964334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:05.964291    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:07.126476 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:07.126443    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:10.039275 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:10.039222    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:10.233406 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:10.233369    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:12.128294 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:12.128219    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:12.586527 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:12.586495    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:12.801272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:12.801234    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:13.451659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:13.451627    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:34:13.452080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:13.451889    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:34:17.459856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:17.459779    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:22.529542 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:22.529505    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:24.882188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:24.882131    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"]
Oct 30 20:34:24.995077 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:24.995040    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"]
Oct 30 20:34:25.329217 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:25.329180    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:25.481073 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:25.481033    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:26.987326 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:26.987284    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:28.216928 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:34:28.216891    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:34:28.579272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:28.579232    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:28.797165 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:28.797126    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:29.008425 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:29.008322    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:29.119611 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:29.119574    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"]
Oct 30 20:34:29.165706 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:29.165668    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-487c5f-r6zn2"]
Oct 30 20:34:29.542930 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:29.542897    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:29.587551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:29.587516    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a250e50e-ce45-4e3f-ae10-83048da01ad5" path="/var/lib/kubelet/pods/a250e50e-ce45-4e3f-ae10-83048da01ad5/volumes"
Oct 30 20:34:29.883146 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:29.883048    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6" podUID="da1ce8df-cc26-42d7-a76d-b5d63110521a" containerName="payload-processing" containerID="cri-o://eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b" gracePeriod=25
Oct 30 20:34:29.995662 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:29.995621    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn" podUID="2b05030d-6dbd-4f36-9304-cf5cd028b99d" containerName="payload-pre-processing" containerID="cri-o://dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247" gracePeriod=25
Oct 30 20:34:30.166205 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.166179    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:34:30.258132 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.258104    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/da1ce8df-cc26-42d7-a76d-b5d63110521a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da1ce8df-cc26-42d7-a76d-b5d63110521a-plugins-config-volume\") pod \"da1ce8df-cc26-42d7-a76d-b5d63110521a\" (UID: \"da1ce8df-cc26-42d7-a76d-b5d63110521a\") "
Oct 30 20:34:30.258311 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.258298    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da1ce8df-cc26-42d7-a76d-b5d63110521a-kube-api-access-z4zg6\" (UniqueName: \"kubernetes.io/projected/da1ce8df-cc26-42d7-a76d-b5d63110521a-kube-api-access-z4zg6\") pod \"da1ce8df-cc26-42d7-a76d-b5d63110521a\" (UID: \"da1ce8df-cc26-42d7-a76d-b5d63110521a\") "
Oct 30 20:34:30.258491 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.258470    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da1ce8df-cc26-42d7-a76d-b5d63110521a-plugins-config-volume" pod "da1ce8df-cc26-42d7-a76d-b5d63110521a" (UID: "da1ce8df-cc26-42d7-a76d-b5d63110521a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:34:30.258712 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.258696    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da1ce8df-cc26-42d7-a76d-b5d63110521a-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:30.260491 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.260467    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da1ce8df-cc26-42d7-a76d-b5d63110521a-kube-api-access-z4zg6" pod "da1ce8df-cc26-42d7-a76d-b5d63110521a" (UID: "da1ce8df-cc26-42d7-a76d-b5d63110521a"). InnerVolumeSpecName "kube-api-access-z4zg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:34:30.279319 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.279290    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:34:30.359693 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.359654    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b05030d-6dbd-4f36-9304-cf5cd028b99d-kube-api-access-dm9mj\" (UniqueName: \"kubernetes.io/projected/2b05030d-6dbd-4f36-9304-cf5cd028b99d-kube-api-access-dm9mj\") pod \"2b05030d-6dbd-4f36-9304-cf5cd028b99d\" (UID: \"2b05030d-6dbd-4f36-9304-cf5cd028b99d\") "
Oct 30 20:34:30.359917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.359718    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b05030d-6dbd-4f36-9304-cf5cd028b99d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b05030d-6dbd-4f36-9304-cf5cd028b99d-plugins-config-volume\") pod \"2b05030d-6dbd-4f36-9304-cf5cd028b99d\" (UID: \"2b05030d-6dbd-4f36-9304-cf5cd028b99d\") "
Oct 30 20:34:30.360205 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.360178    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b05030d-6dbd-4f36-9304-cf5cd028b99d-plugins-config-volume" pod "2b05030d-6dbd-4f36-9304-cf5cd028b99d" (UID: "2b05030d-6dbd-4f36-9304-cf5cd028b99d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:34:30.360245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.360202    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4zg6\" (UniqueName: \"kubernetes.io/projected/da1ce8df-cc26-42d7-a76d-b5d63110521a-kube-api-access-z4zg6\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:30.362064 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.362044    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b05030d-6dbd-4f36-9304-cf5cd028b99d-kube-api-access-dm9mj" pod "2b05030d-6dbd-4f36-9304-cf5cd028b99d" (UID: "2b05030d-6dbd-4f36-9304-cf5cd028b99d"). InnerVolumeSpecName "kube-api-access-dm9mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:34:30.461239 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.461160    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm9mj\" (UniqueName: \"kubernetes.io/projected/2b05030d-6dbd-4f36-9304-cf5cd028b99d-kube-api-access-dm9mj\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:30.461239 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.461191    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b05030d-6dbd-4f36-9304-cf5cd028b99d-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:30.653587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.653546    6015 generic.go:356] "Generic (PLEG): container finished" podID="2b05030d-6dbd-4f36-9304-cf5cd028b99d" containerID="dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247" exitCode=0
Oct 30 20:34:30.654156 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.653597    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"
Oct 30 20:34:30.654156 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.653621    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn" event={"ID":"2b05030d-6dbd-4f36-9304-cf5cd028b99d","Type":"ContainerDied","Data":"dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247"}
Oct 30 20:34:30.654156 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.653694    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn" event={"ID":"2b05030d-6dbd-4f36-9304-cf5cd028b99d","Type":"ContainerDied","Data":"d86683383ec009d3050b7e9fe1736fdfc98a17d663962fad4d841aad3deae9f4"}
Oct 30 20:34:30.654156 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.653727    6015 scope.go:122] "RemoveContainer" containerID="dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247"
Oct 30 20:34:30.655390 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.655364    6015 generic.go:356] "Generic (PLEG): container finished" podID="da1ce8df-cc26-42d7-a76d-b5d63110521a" containerID="eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b" exitCode=0
Oct 30 20:34:30.655568 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.655439    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6" event={"ID":"da1ce8df-cc26-42d7-a76d-b5d63110521a","Type":"ContainerDied","Data":"eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b"}
Oct 30 20:34:30.655568 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.655484    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6" event={"ID":"da1ce8df-cc26-42d7-a76d-b5d63110521a","Type":"ContainerDied","Data":"abee8c37bf10c0201d7406ac4f0bd341159e4ec42d19a077ff8d9880f1eaf5ea"}
Oct 30 20:34:30.655568 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.655440    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"
Oct 30 20:34:30.668896 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.668876    6015 scope.go:122] "RemoveContainer" containerID="dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247"
Oct 30 20:34:30.669239 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:34:30.669221    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247\": container with ID starting with dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247 not found: ID does not exist" containerID="dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247"
Oct 30 20:34:30.669308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.669248    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247"} err="failed to get container status \"dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247\": rpc error: code = NotFound desc = could not find container \"dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247\": container with ID starting with dc3e51dfe0568ed4eaa7d34df6cc9092842b7cb3192a207b2f55683701ce7247 not found: ID does not exist"
Oct 30 20:34:30.669308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.669265    6015 scope.go:122] "RemoveContainer" containerID="eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b"
Oct 30 20:34:30.679461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.679438    6015 scope.go:122] "RemoveContainer" containerID="eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b"
Oct 30 20:34:30.679842 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:34:30.679785    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b\": container with ID starting with eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b not found: ID does not exist" containerID="eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b"
Oct 30 20:34:30.679932 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.679851    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b"} err="failed to get container status \"eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b\": rpc error: code = NotFound desc = could not find container \"eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b\": container with ID starting with eab41c28033778f141d8093782655b18486b91adb75edc96ee5a78fe1c1e5f9b not found: ID does not exist"
Oct 30 20:34:30.813689 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.813652    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"]
Oct 30 20:34:30.862025 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.861989    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-0e72bd-7489898b95-dphnn"]
Oct 30 20:34:30.925878 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.925844    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"]
Oct 30 20:34:30.930456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:30.930427    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-0e72bd-547d5b58c6-884k6"]
Oct 30 20:34:31.586783 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:31.586751    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b05030d-6dbd-4f36-9304-cf5cd028b99d" path="/var/lib/kubelet/pods/2b05030d-6dbd-4f36-9304-cf5cd028b99d/volumes"
Oct 30 20:34:31.587315 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:31.587298    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="da1ce8df-cc26-42d7-a76d-b5d63110521a" path="/var/lib/kubelet/pods/da1ce8df-cc26-42d7-a76d-b5d63110521a/volumes"
Oct 30 20:34:34.292604 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:34.292566    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:36.369692 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:36.369638    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:36.674158 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:36.674058    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:36.831971 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:36.831933    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"]
Oct 30 20:34:36.832182 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:36.832157    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy" containerID="cri-o://965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4" gracePeriod=30
Oct 30 20:34:36.843424 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:36.843388    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:39.393227 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:39.393129    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:40.988302 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:40.988261    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:41.283966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:41.283874    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:41.454898 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:41.454853    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:42.011523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.011383    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:42.109652 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.109572    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:34:42.223800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.223764    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-credential-socket\") pod \"41109844-dc57-4bb7-a1db-719717d9cbb9\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") "
Oct 30 20:34:42.224016 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.223886    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-podinfo\") pod \"41109844-dc57-4bb7-a1db-719717d9cbb9\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") "
Oct 30 20:34:42.224016 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.223959    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-certs\") pod \"41109844-dc57-4bb7-a1db-719717d9cbb9\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") "
Oct 30 20:34:42.224138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.224015    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/41109844-dc57-4bb7-a1db-719717d9cbb9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41109844-dc57-4bb7-a1db-719717d9cbb9-istiod-ca-cert\") pod \"41109844-dc57-4bb7-a1db-719717d9cbb9\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") "
Oct 30 20:34:42.224138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.224069    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-socket\") pod \"41109844-dc57-4bb7-a1db-719717d9cbb9\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") "
Oct 30 20:34:42.224138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.224073    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-credential-socket" pod "41109844-dc57-4bb7-a1db-719717d9cbb9" (UID: "41109844-dc57-4bb7-a1db-719717d9cbb9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:34:42.224138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.224098    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-envoy\") pod \"41109844-dc57-4bb7-a1db-719717d9cbb9\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") "
Oct 30 20:34:42.224138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.224136    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-kube-api-access-rbzlb\" (UniqueName: \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-kube-api-access-rbzlb\") pod \"41109844-dc57-4bb7-a1db-719717d9cbb9\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") "
Oct 30 20:34:42.224407 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.224209    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-data\") pod \"41109844-dc57-4bb7-a1db-719717d9cbb9\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") "
Oct 30 20:34:42.224407 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.224263    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-token\" (UniqueName: \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-token\") pod \"41109844-dc57-4bb7-a1db-719717d9cbb9\" (UID: \"41109844-dc57-4bb7-a1db-719717d9cbb9\") "
Oct 30 20:34:42.224407 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.224375    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-certs" pod "41109844-dc57-4bb7-a1db-719717d9cbb9" (UID: "41109844-dc57-4bb7-a1db-719717d9cbb9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:34:42.224575 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.224425    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41109844-dc57-4bb7-a1db-719717d9cbb9-istiod-ca-cert" pod "41109844-dc57-4bb7-a1db-719717d9cbb9" (UID: "41109844-dc57-4bb7-a1db-719717d9cbb9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:34:42.224662 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.224630    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-data" pod "41109844-dc57-4bb7-a1db-719717d9cbb9" (UID: "41109844-dc57-4bb7-a1db-719717d9cbb9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:34:42.224731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.224665    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-socket" pod "41109844-dc57-4bb7-a1db-719717d9cbb9" (UID: "41109844-dc57-4bb7-a1db-719717d9cbb9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:34:42.225218 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.225175    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:42.225218 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.225207    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:42.225449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.225224    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:42.225449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.225238    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41109844-dc57-4bb7-a1db-719717d9cbb9-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:42.225449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.225254    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:42.226781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.226757    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-podinfo" pod "41109844-dc57-4bb7-a1db-719717d9cbb9" (UID: "41109844-dc57-4bb7-a1db-719717d9cbb9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:34:42.227048 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.227020    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-envoy" pod "41109844-dc57-4bb7-a1db-719717d9cbb9" (UID: "41109844-dc57-4bb7-a1db-719717d9cbb9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:34:42.227139 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.227053    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-kube-api-access-rbzlb" pod "41109844-dc57-4bb7-a1db-719717d9cbb9" (UID: "41109844-dc57-4bb7-a1db-719717d9cbb9"). InnerVolumeSpecName "kube-api-access-rbzlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:34:42.227139 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.227096    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-token" pod "41109844-dc57-4bb7-a1db-719717d9cbb9" (UID: "41109844-dc57-4bb7-a1db-719717d9cbb9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:34:42.326301 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.326261    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:42.326301 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.326295    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:42.326301 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.326305    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41109844-dc57-4bb7-a1db-719717d9cbb9-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:42.326557 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.326314    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbzlb\" (UniqueName: \"kubernetes.io/projected/41109844-dc57-4bb7-a1db-719717d9cbb9-kube-api-access-rbzlb\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:42.742337 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.742302    6015 generic.go:356] "Generic (PLEG): container finished" podID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerID="965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4" exitCode=0
Oct 30 20:34:42.742521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.742360    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"
Oct 30 20:34:42.742521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.742379    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" event={"ID":"41109844-dc57-4bb7-a1db-719717d9cbb9","Type":"ContainerDied","Data":"965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4"}
Oct 30 20:34:42.742521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.742420    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk" event={"ID":"41109844-dc57-4bb7-a1db-719717d9cbb9","Type":"ContainerDied","Data":"8bd178285a448ea75b9154bb61ea8e10e1b792ab98ba5db7060c3cb164f2c10b"}
Oct 30 20:34:42.742521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.742441    6015 scope.go:122] "RemoveContainer" containerID="965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4"
Oct 30 20:34:42.755135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.755104    6015 scope.go:122] "RemoveContainer" containerID="1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7"
Oct 30 20:34:42.765523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.765501    6015 scope.go:122] "RemoveContainer" containerID="965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4"
Oct 30 20:34:42.765864 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:34:42.765835    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4\": container with ID starting with 965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4 not found: ID does not exist" containerID="965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4"
Oct 30 20:34:42.766000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.765869    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4"} err="failed to get container status \"965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4\": rpc error: code = NotFound desc = could not find container \"965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4\": container with ID starting with 965aec1af467e58e200b6e496065ff49a5c79ec0b056bde88654b1d7ce94e5d4 not found: ID does not exist"
Oct 30 20:34:42.766000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.765890    6015 scope.go:122] "RemoveContainer" containerID="1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7"
Oct 30 20:34:42.766197 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:34:42.766181    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7\": container with ID starting with 1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7 not found: ID does not exist" containerID="1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7"
Oct 30 20:34:42.766252 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.766204    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7"} err="failed to get container status \"1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7\": rpc error: code = NotFound desc = could not find container \"1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7\": container with ID starting with 1b91c47db694c0caa1134b290c307a2c7c383a82b44a1c64426c7de3735444a7 not found: ID does not exist"
Oct 30 20:34:42.916325 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.916289    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"]
Oct 30 20:34:42.963727 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:42.963689    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-487c5f-openshift-default-d66698ddc-89kgk"]
Oct 30 20:34:43.586092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:43.586054    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" path="/var/lib/kubelet/pods/41109844-dc57-4bb7-a1db-719717d9cbb9/volumes"
Oct 30 20:34:46.692771 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:46.692678    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:48.920463 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:48.920420    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:49.074757 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:49.074701    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:49.278572 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:49.278477    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"]
Oct 30 20:34:49.278912 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:49.278879    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy" containerID="cri-o://32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35" gracePeriod=30
Oct 30 20:34:49.333197 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:49.333148    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:49.669592 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:49.669554    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:49.838906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:49.838780    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:50.818191 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:50.818153    6015 patch_prober.go:29] interesting pod/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:34:50.818672 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:50.818257    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:34:52.416773 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:52.416725    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:54.563460 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.563433    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:34:54.606207 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606168    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-credential-socket\") pod \"05b24513-c127-49cf-a507-735fe4e47192\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") "
Oct 30 20:34:54.606394 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606279    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-certs\") pod \"05b24513-c127-49cf-a507-735fe4e47192\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") "
Oct 30 20:34:54.606394 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606336    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-kube-api-access-zs2ft\" (UniqueName: \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-kube-api-access-zs2ft\") pod \"05b24513-c127-49cf-a507-735fe4e47192\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") "
Oct 30 20:34:54.606394 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606360    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-socket\") pod \"05b24513-c127-49cf-a507-735fe4e47192\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") "
Oct 30 20:34:54.606558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606410    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-data\") pod \"05b24513-c127-49cf-a507-735fe4e47192\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") "
Oct 30 20:34:54.606558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606458    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05b24513-c127-49cf-a507-735fe4e47192-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b24513-c127-49cf-a507-735fe4e47192-istiod-ca-cert\") pod \"05b24513-c127-49cf-a507-735fe4e47192\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") "
Oct 30 20:34:54.606558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606496    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-istio-token\" (UniqueName: \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-istio-token\") pod \"05b24513-c127-49cf-a507-735fe4e47192\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") "
Oct 30 20:34:54.606558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606489    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-credential-socket" pod "05b24513-c127-49cf-a507-735fe4e47192" (UID: "05b24513-c127-49cf-a507-735fe4e47192"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:34:54.606781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606559    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-certs" pod "05b24513-c127-49cf-a507-735fe4e47192" (UID: "05b24513-c127-49cf-a507-735fe4e47192"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:34:54.606781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606568    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/05b24513-c127-49cf-a507-735fe4e47192-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b24513-c127-49cf-a507-735fe4e47192-istio-podinfo\") pod \"05b24513-c127-49cf-a507-735fe4e47192\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") "
Oct 30 20:34:54.606781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606621    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-envoy\") pod \"05b24513-c127-49cf-a507-735fe4e47192\" (UID: \"05b24513-c127-49cf-a507-735fe4e47192\") "
Oct 30 20:34:54.606781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606691    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-socket" pod "05b24513-c127-49cf-a507-735fe4e47192" (UID: "05b24513-c127-49cf-a507-735fe4e47192"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:34:54.606781 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606707    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-data" pod "05b24513-c127-49cf-a507-735fe4e47192" (UID: "05b24513-c127-49cf-a507-735fe4e47192"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:34:54.607110 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.606880    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05b24513-c127-49cf-a507-735fe4e47192-istiod-ca-cert" pod "05b24513-c127-49cf-a507-735fe4e47192" (UID: "05b24513-c127-49cf-a507-735fe4e47192"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:34:54.607454 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.607428    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:54.607522 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.607461    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:54.607522 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.607477    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:54.607522 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.607492    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:54.607522 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.607504    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b24513-c127-49cf-a507-735fe4e47192-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:54.608928 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.608905    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-envoy" pod "05b24513-c127-49cf-a507-735fe4e47192" (UID: "05b24513-c127-49cf-a507-735fe4e47192"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:34:54.608928 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.608919    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-kube-api-access-zs2ft" pod "05b24513-c127-49cf-a507-735fe4e47192" (UID: "05b24513-c127-49cf-a507-735fe4e47192"). InnerVolumeSpecName "kube-api-access-zs2ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:34:54.609454 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.609429    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05b24513-c127-49cf-a507-735fe4e47192-istio-podinfo" pod "05b24513-c127-49cf-a507-735fe4e47192" (UID: "05b24513-c127-49cf-a507-735fe4e47192"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:34:54.609571 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.609454    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-istio-token" pod "05b24513-c127-49cf-a507-735fe4e47192" (UID: "05b24513-c127-49cf-a507-735fe4e47192"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:34:54.709214 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.709177    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs2ft\" (UniqueName: \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-kube-api-access-zs2ft\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:54.709214 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.709214    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b24513-c127-49cf-a507-735fe4e47192-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:54.709431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.709228    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b24513-c127-49cf-a507-735fe4e47192-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:54.709431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.709241    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b24513-c127-49cf-a507-735fe4e47192-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:34:54.859000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.858961    6015 generic.go:356] "Generic (PLEG): container finished" podID="05b24513-c127-49cf-a507-735fe4e47192" containerID="32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35" exitCode=0
Oct 30 20:34:54.859182 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.859042    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"
Oct 30 20:34:54.859182 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.859041    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" event={"ID":"05b24513-c127-49cf-a507-735fe4e47192","Type":"ContainerDied","Data":"32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35"}
Oct 30 20:34:54.859263 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.859189    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw" event={"ID":"05b24513-c127-49cf-a507-735fe4e47192","Type":"ContainerDied","Data":"1a1344775c2777f93c201d7c2872c0e4da13d2731c6bfbe090ea0e6849884798"}
Oct 30 20:34:54.859263 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.859213    6015 scope.go:122] "RemoveContainer" containerID="32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35"
Oct 30 20:34:54.870701 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.870680    6015 scope.go:122] "RemoveContainer" containerID="ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7"
Oct 30 20:34:54.880078 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.880056    6015 scope.go:122] "RemoveContainer" containerID="32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35"
Oct 30 20:34:54.880356 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:34:54.880339    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35\": container with ID starting with 32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35 not found: ID does not exist" containerID="32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35"
Oct 30 20:34:54.880396 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.880365    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35"} err="failed to get container status \"32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35\": rpc error: code = NotFound desc = could not find container \"32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35\": container with ID starting with 32a8aa1c56b4b7dd94e65acb1ba3bec2e71db954de2e748c5e3b4f9a6ca2aa35 not found: ID does not exist"
Oct 30 20:34:54.880396 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.880384    6015 scope.go:122] "RemoveContainer" containerID="ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7"
Oct 30 20:34:54.880616 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:34:54.880603    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7\": container with ID starting with ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7 not found: ID does not exist" containerID="ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7"
Oct 30 20:34:54.880659 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:54.880622    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7"} err="failed to get container status \"ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7\": rpc error: code = NotFound desc = could not find container \"ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7\": container with ID starting with ccf0f8e2daaf7e08a085e03638a2774177116988b5398af6ce78302a0fd875c7 not found: ID does not exist"
Oct 30 20:34:55.030874 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:55.030797    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"]
Oct 30 20:34:55.037542 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:55.037513    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w1-cafbb2-openshift-default-5bf5df9b9c-9hqjw"]
Oct 30 20:34:55.587237 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:55.587202    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="05b24513-c127-49cf-a507-735fe4e47192" path="/var/lib/kubelet/pods/05b24513-c127-49cf-a507-735fe4e47192/volumes"
Oct 30 20:34:57.475564 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:34:57.475524    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:34:58.217378 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:34:58.217343    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:35:02.179658 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:02.179621    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:02.342338 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:02.342292    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:02.520355 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:02.520255    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:02.717108 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:02.717072    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:03.332528 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:03.332489    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:03.482046 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:03.482009    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:07.492382 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:07.492344    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:09.732972 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:09.732930    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:12.548634 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:12.548601    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:17.453193 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:17.453156    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:17.657606 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:17.657573    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:17.818683 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:17.818646    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:22.029335 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:22.029289    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:23.756247 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:23.756204    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:23.960510 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:23.960467    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:24.108562 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:24.108523    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:24.202929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:24.202895    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"]
Oct 30 20:35:24.253565 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:24.253526    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w4-b91df1-5vvfk"]
Oct 30 20:35:24.655226 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:24.655188    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:25.586642 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:25.586605    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f267cd16-d777-4f24-b0b9-ba709966d733" path="/var/lib/kubelet/pods/f267cd16-d777-4f24-b0b9-ba709966d733/volumes"
Oct 30 20:35:28.219603 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:35:28.219565    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:35:29.304155 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:29.304117    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:31.320359 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:31.320320    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:31.530698 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:31.530653    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:31.672194 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:31.672079    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"]
Oct 30 20:35:31.672408 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:31.672362    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy" containerID="cri-o://d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7" gracePeriod=30
Oct 30 20:35:31.708369 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:31.708323    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:32.337139 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:32.337104    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:34.692336 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:34.692287    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:36.949347 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.949270    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:35:36.952220 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.952198    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-envoy\") pod \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") "
Oct 30 20:35:36.952289 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.952230    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-data\") pod \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") "
Oct 30 20:35:36.952289 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.952259    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-token\" (UniqueName: \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-token\") pod \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") "
Oct 30 20:35:36.952357 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.952326    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-kube-api-access-9cpbg\" (UniqueName: \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-kube-api-access-9cpbg\") pod \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") "
Oct 30 20:35:36.952491 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.952467    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-data" pod "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" (UID: "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:36.952564 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.952540    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-certs\") pod \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") "
Oct 30 20:35:36.952635 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.952617    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-podinfo\") pod \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") "
Oct 30 20:35:36.952721 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.952708    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-credential-socket\") pod \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") "
Oct 30 20:35:36.952788 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.952772    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-certs" pod "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" (UID: "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:36.952882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.952838    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-socket\") pod \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") "
Oct 30 20:35:36.952947 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.952877    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istiod-ca-cert\") pod \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\" (UID: \"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5\") "
Oct 30 20:35:36.953049 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.953021    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-socket" pod "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" (UID: "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:36.953187 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.953164    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-credential-socket" pod "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" (UID: "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:36.953452 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.953428    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istiod-ca-cert" pod "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" (UID: "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:35:36.953540 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.953520    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:36.953583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.953547    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:36.953583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.953561    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:36.953583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.953575    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:36.954791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.954768    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-kube-api-access-9cpbg" pod "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" (UID: "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5"). InnerVolumeSpecName "kube-api-access-9cpbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:35:36.954791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.954782    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-podinfo" pod "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" (UID: "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:35:36.955160 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.955128    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-envoy" pod "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" (UID: "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:36.955506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:36.955489    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-token" pod "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" (UID: "afc16ca4-a83c-41aa-8853-5bb0ec6d58e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:35:37.054422 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.054386    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:37.054422 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.054415    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:37.054422 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.054426    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cpbg\" (UniqueName: \"kubernetes.io/projected/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-kube-api-access-9cpbg\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:37.054675 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.054436    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:37.054675 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.054446    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:37.156630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.156584    6015 generic.go:356] "Generic (PLEG): container finished" podID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerID="d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7" exitCode=0
Oct 30 20:35:37.156831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.156698    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" event={"ID":"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5","Type":"ContainerDied","Data":"d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7"}
Oct 30 20:35:37.156831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.156718    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"
Oct 30 20:35:37.156831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.156794    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz" event={"ID":"afc16ca4-a83c-41aa-8853-5bb0ec6d58e5","Type":"ContainerDied","Data":"52f405faab31242adf582e6f8372dea715cbd528e1076b9928c51605548f234e"}
Oct 30 20:35:37.156957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.156846    6015 scope.go:122] "RemoveContainer" containerID="d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7"
Oct 30 20:35:37.169090 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.169066    6015 scope.go:122] "RemoveContainer" containerID="7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc"
Oct 30 20:35:37.181676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.181646    6015 scope.go:122] "RemoveContainer" containerID="d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7"
Oct 30 20:35:37.182072 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:35:37.182050    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7\": container with ID starting with d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7 not found: ID does not exist" containerID="d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7"
Oct 30 20:35:37.182171 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.182079    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7"} err="failed to get container status \"d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7\": rpc error: code = NotFound desc = could not find container \"d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7\": container with ID starting with d2a2a76c48066155e31548dec0305c7962f858d2d2bf784258404305a7dadfd7 not found: ID does not exist"
Oct 30 20:35:37.182171 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.182098    6015 scope.go:122] "RemoveContainer" containerID="7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc"
Oct 30 20:35:37.182446 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:35:37.182428    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc\": container with ID starting with 7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc not found: ID does not exist" containerID="7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc"
Oct 30 20:35:37.182494 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.182453    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc"} err="failed to get container status \"7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc\": rpc error: code = NotFound desc = could not find container \"7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc\": container with ID starting with 7149dbfbcf15947e5bcf8e2560c4d48bf897015b7fe4680f61f7b625aea7e5cc not found: ID does not exist"
Oct 30 20:35:37.212541 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.212448    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"]
Oct 30 20:35:37.224481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.224448    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"]
Oct 30 20:35:37.383217 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.383178    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:37.453891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.453839    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"]
Oct 30 20:35:37.459858 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.459824    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-b91df1-openshift-default-85bff8b855-rrhgz"]
Oct 30 20:35:37.589112 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:37.589073    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" path="/var/lib/kubelet/pods/afc16ca4-a83c-41aa-8853-5bb0ec6d58e5/volumes"
Oct 30 20:35:39.593078 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:39.593037    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:41.361654 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:41.361615    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:41.805404 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:41.805365    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:41.961103 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:41.961064    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:42.398386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:42.398340    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:42.780877 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:42.780759    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:42.930584 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:42.930544    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:44.333325 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:44.333287    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"]
Oct 30 20:35:44.444012 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:44.443975    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"]
Oct 30 20:35:44.727638 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:44.727536    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:44.909165 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:44.909130    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:47.300170 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:47.300129    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:48.751352 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:48.751316    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:48.922685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:48.922650    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:49.125489 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:49.125449    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:49.333964 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:49.333913    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4" podUID="0abbe2cc-d0e2-4504-893c-698a1e1c246c" containerName="payload-processing" containerID="cri-o://0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5" gracePeriod=25
Oct 30 20:35:49.444327 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:49.444225    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57" podUID="b54a968f-61c5-4a4f-a7b1-6764c5828d89" containerName="payload-pre-processing" containerID="cri-o://4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24" gracePeriod=25
Oct 30 20:35:52.235514 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.235472    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd" podUID="d132ed73-6a9c-4be9-8682-ec854f7b5300" containerName="main" containerID="cri-o://79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7" gracePeriod=45
Oct 30 20:35:52.246627 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.246591    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx" podUID="179f17ce-6608-4f79-9c5a-e675719d5bef" containerName="main" containerID="cri-o://99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568" gracePeriod=45
Oct 30 20:35:52.443520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.443449    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57" podUID="b54a968f-61c5-4a4f-a7b1-6764c5828d89" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:35:52.444185 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.444142    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4" podUID="0abbe2cc-d0e2-4504-893c-698a1e1c246c" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:35:52.558744 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.558711    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 20:35:52.571026 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.570996    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 20:35:52.660944 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.660895    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/179f17ce-6608-4f79-9c5a-e675719d5bef-tls-certs\" (UniqueName: \"kubernetes.io/secret/179f17ce-6608-4f79-9c5a-e675719d5bef-tls-certs\") pod \"179f17ce-6608-4f79-9c5a-e675719d5bef\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") "
Oct 30 20:35:52.661151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.661042    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d132ed73-6a9c-4be9-8682-ec854f7b5300-tls-certs\" (UniqueName: \"kubernetes.io/secret/d132ed73-6a9c-4be9-8682-ec854f7b5300-tls-certs\") pod \"d132ed73-6a9c-4be9-8682-ec854f7b5300\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") "
Oct 30 20:35:52.661151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.661095    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d132ed73-6a9c-4be9-8682-ec854f7b5300-kube-api-access-7llnx\" (UniqueName: \"kubernetes.io/projected/d132ed73-6a9c-4be9-8682-ec854f7b5300-kube-api-access-7llnx\") pod \"d132ed73-6a9c-4be9-8682-ec854f7b5300\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") "
Oct 30 20:35:52.661151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.661128    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-home\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-home\") pod \"d132ed73-6a9c-4be9-8682-ec854f7b5300\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") "
Oct 30 20:35:52.661523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.661161    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-dshm\") pod \"d132ed73-6a9c-4be9-8682-ec854f7b5300\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") "
Oct 30 20:35:52.661523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.661216    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-home\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-home\") pod \"179f17ce-6608-4f79-9c5a-e675719d5bef\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") "
Oct 30 20:35:52.661523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.661246    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-tmp-dir\") pod \"179f17ce-6608-4f79-9c5a-e675719d5bef\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") "
Oct 30 20:35:52.661523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.661335    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-model-cache\") pod \"d132ed73-6a9c-4be9-8682-ec854f7b5300\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") "
Oct 30 20:35:52.661523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.661424    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-dshm\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-dshm\") pod \"179f17ce-6608-4f79-9c5a-e675719d5bef\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") "
Oct 30 20:35:52.661523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.661485    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-tmp-dir\") pod \"d132ed73-6a9c-4be9-8682-ec854f7b5300\" (UID: \"d132ed73-6a9c-4be9-8682-ec854f7b5300\") "
Oct 30 20:35:52.661523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.661516    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/179f17ce-6608-4f79-9c5a-e675719d5bef-kube-api-access-mw7zd\" (UniqueName: \"kubernetes.io/projected/179f17ce-6608-4f79-9c5a-e675719d5bef-kube-api-access-mw7zd\") pod \"179f17ce-6608-4f79-9c5a-e675719d5bef\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") "
Oct 30 20:35:52.662045 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.661551    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-model-cache\") pod \"179f17ce-6608-4f79-9c5a-e675719d5bef\" (UID: \"179f17ce-6608-4f79-9c5a-e675719d5bef\") "
Oct 30 20:35:52.662382 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.662351    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-model-cache" pod "179f17ce-6608-4f79-9c5a-e675719d5bef" (UID: "179f17ce-6608-4f79-9c5a-e675719d5bef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:52.662489 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.662456    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-model-cache" pod "d132ed73-6a9c-4be9-8682-ec854f7b5300" (UID: "d132ed73-6a9c-4be9-8682-ec854f7b5300"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:52.662705 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.662677    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-home" pod "179f17ce-6608-4f79-9c5a-e675719d5bef" (UID: "179f17ce-6608-4f79-9c5a-e675719d5bef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:52.662921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.662895    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-tmp-dir" pod "179f17ce-6608-4f79-9c5a-e675719d5bef" (UID: "179f17ce-6608-4f79-9c5a-e675719d5bef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:52.663236 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.663209    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-tmp-dir" pod "d132ed73-6a9c-4be9-8682-ec854f7b5300" (UID: "d132ed73-6a9c-4be9-8682-ec854f7b5300"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:52.663554 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.663529    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-home" pod "d132ed73-6a9c-4be9-8682-ec854f7b5300" (UID: "d132ed73-6a9c-4be9-8682-ec854f7b5300"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:52.664445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.664415    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d132ed73-6a9c-4be9-8682-ec854f7b5300-tls-certs" pod "d132ed73-6a9c-4be9-8682-ec854f7b5300" (UID: "d132ed73-6a9c-4be9-8682-ec854f7b5300"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:35:52.665054 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.665027    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-dshm" pod "179f17ce-6608-4f79-9c5a-e675719d5bef" (UID: "179f17ce-6608-4f79-9c5a-e675719d5bef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:52.665369 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.665341    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/179f17ce-6608-4f79-9c5a-e675719d5bef-tls-certs" pod "179f17ce-6608-4f79-9c5a-e675719d5bef" (UID: "179f17ce-6608-4f79-9c5a-e675719d5bef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:35:52.665876 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.665842    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-dshm" pod "d132ed73-6a9c-4be9-8682-ec854f7b5300" (UID: "d132ed73-6a9c-4be9-8682-ec854f7b5300"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:35:52.665981 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.665893    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d132ed73-6a9c-4be9-8682-ec854f7b5300-kube-api-access-7llnx" pod "d132ed73-6a9c-4be9-8682-ec854f7b5300" (UID: "d132ed73-6a9c-4be9-8682-ec854f7b5300"). InnerVolumeSpecName "kube-api-access-7llnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:35:52.667224 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.667197    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/179f17ce-6608-4f79-9c5a-e675719d5bef-kube-api-access-mw7zd" pod "179f17ce-6608-4f79-9c5a-e675719d5bef" (UID: "179f17ce-6608-4f79-9c5a-e675719d5bef"). InnerVolumeSpecName "kube-api-access-mw7zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:35:52.728049 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.728011    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:52.763400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763315    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:52.763400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763345    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:52.763400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763356    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:52.763400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763367    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:52.763400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763377    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:52.763400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763386    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw7zd\" (UniqueName: \"kubernetes.io/projected/179f17ce-6608-4f79-9c5a-e675719d5bef-kube-api-access-mw7zd\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:52.763400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763395    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/179f17ce-6608-4f79-9c5a-e675719d5bef-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:52.763400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763403    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/179f17ce-6608-4f79-9c5a-e675719d5bef-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:52.763779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763412    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d132ed73-6a9c-4be9-8682-ec854f7b5300-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:52.763779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763420    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7llnx\" (UniqueName: \"kubernetes.io/projected/d132ed73-6a9c-4be9-8682-ec854f7b5300-kube-api-access-7llnx\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:52.763779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763428    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:52.763779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:52.763436    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d132ed73-6a9c-4be9-8682-ec854f7b5300-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:35:53.264730 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.264696    6015 generic.go:356] "Generic (PLEG): container finished" podID="d132ed73-6a9c-4be9-8682-ec854f7b5300" containerID="79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7" exitCode=0
Oct 30 20:35:53.265196 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.264737    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"
Oct 30 20:35:53.265196 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.264773    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd" event={"ID":"d132ed73-6a9c-4be9-8682-ec854f7b5300","Type":"ContainerDied","Data":"79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7"}
Oct 30 20:35:53.265196 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.264861    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd" event={"ID":"d132ed73-6a9c-4be9-8682-ec854f7b5300","Type":"ContainerDied","Data":"f2844ceeff6863f6bd39c768bd8c3d1683f08d4cece36e5edb0d3c0d019f3707"}
Oct 30 20:35:53.265196 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.264886    6015 scope.go:122] "RemoveContainer" containerID="79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7"
Oct 30 20:35:53.267684 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.267658    6015 generic.go:356] "Generic (PLEG): container finished" podID="179f17ce-6608-4f79-9c5a-e675719d5bef" containerID="99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568" exitCode=0
Oct 30 20:35:53.267784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.267738    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx" event={"ID":"179f17ce-6608-4f79-9c5a-e675719d5bef","Type":"ContainerDied","Data":"99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568"}
Oct 30 20:35:53.267784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.267773    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx" event={"ID":"179f17ce-6608-4f79-9c5a-e675719d5bef","Type":"ContainerDied","Data":"18f88eba3d3a2af84d7e6601ca4cd732d075cb4e56db922e135e63d2d65b7d9a"}
Oct 30 20:35:53.267949 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.267932    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"
Oct 30 20:35:53.278638 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.278603    6015 scope.go:122] "RemoveContainer" containerID="79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7"
Oct 30 20:35:53.279085 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:35:53.279054    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7\": container with ID starting with 79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7 not found: ID does not exist" containerID="79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7"
Oct 30 20:35:53.279209 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.279096    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7"} err="failed to get container status \"79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7\": rpc error: code = NotFound desc = could not find container \"79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7\": container with ID starting with 79e4636366af8af28440351064f07eaa9c3e8caa756b35aa12fe5ae4969357a7 not found: ID does not exist"
Oct 30 20:35:53.279209 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.279119    6015 scope.go:122] "RemoveContainer" containerID="99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568"
Oct 30 20:35:53.291163 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.291098    6015 scope.go:122] "RemoveContainer" containerID="99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568"
Oct 30 20:35:53.291880 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:35:53.291837    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568\": container with ID starting with 99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568 not found: ID does not exist" containerID="99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568"
Oct 30 20:35:53.291989 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.291884    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568"} err="failed to get container status \"99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568\": rpc error: code = NotFound desc = could not find container \"99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568\": container with ID starting with 99d37a84af6ed0e67fcbae0bcb942fd2567699723afb4352a90f7023f64ae568 not found: ID does not exist"
Oct 30 20:35:53.425623 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.425579    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"]
Oct 30 20:35:53.472693 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.472657    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-2-w4-4ec609-kserve-7796d5c755-2gdqd"]
Oct 30 20:35:53.536412 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.536319    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"]
Oct 30 20:35:53.541026 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.540995    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-4ec609/distinct-w4-4ec609-kserve-f6495f8cb-84rgx"]
Oct 30 20:35:53.587398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.587364    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="179f17ce-6608-4f79-9c5a-e675719d5bef" path="/var/lib/kubelet/pods/179f17ce-6608-4f79-9c5a-e675719d5bef/volumes"
Oct 30 20:35:53.587901 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:53.587883    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d132ed73-6a9c-4be9-8682-ec854f7b5300" path="/var/lib/kubelet/pods/d132ed73-6a9c-4be9-8682-ec854f7b5300/volumes"
Oct 30 20:35:57.358495 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:57.358455    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:58.216998 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:35:58.216960    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:35:59.078429 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:59.078387    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:59.355103 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:59.355008    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:35:59.510345 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:35:59.510303    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:00.128170 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:00.128136    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:01.454005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:01.453964    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"]
Oct 30 20:36:01.563561 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:01.563521    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"]
Oct 30 20:36:01.888715 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:01.888679    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:02.056860 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:02.056817    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:02.443914 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:02.443870    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57" podUID="b54a968f-61c5-4a4f-a7b1-6764c5828d89" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:36:02.443914 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:02.443897    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4" podUID="0abbe2cc-d0e2-4504-893c-698a1e1c246c" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:36:03.105999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:03.105960    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:04.905008 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:04.904967    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:06.208515 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.208472    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:06.454908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.454863    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx" podUID="78e13f3d-4713-4a95-8110-42d51d2ca7ee" containerName="payload-processing" containerID="cri-o://aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99" gracePeriod=25
Oct 30 20:36:06.464283 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.464255    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:06.561411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.555496    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"]
Oct 30 20:36:06.561411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.555863    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy" containerID="cri-o://00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff" gracePeriod=30
Oct 30 20:36:06.564080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.564011    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7" podUID="831a6d20-0dfb-489e-9a03-f5cdc918fe9d" containerName="payload-pre-processing" containerID="cri-o://e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d" gracePeriod=25
Oct 30 20:36:06.627856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.623958    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:06.785862 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.782696    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:36:06.834408 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.834382    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/78e13f3d-4713-4a95-8110-42d51d2ca7ee-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78e13f3d-4713-4a95-8110-42d51d2ca7ee-plugins-config-volume\") pod \"78e13f3d-4713-4a95-8110-42d51d2ca7ee\" (UID: \"78e13f3d-4713-4a95-8110-42d51d2ca7ee\") "
Oct 30 20:36:06.834542 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.834442    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/78e13f3d-4713-4a95-8110-42d51d2ca7ee-kube-api-access-w5v7z\" (UniqueName: \"kubernetes.io/projected/78e13f3d-4713-4a95-8110-42d51d2ca7ee-kube-api-access-w5v7z\") pod \"78e13f3d-4713-4a95-8110-42d51d2ca7ee\" (UID: \"78e13f3d-4713-4a95-8110-42d51d2ca7ee\") "
Oct 30 20:36:06.834759 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.834735    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78e13f3d-4713-4a95-8110-42d51d2ca7ee-plugins-config-volume" pod "78e13f3d-4713-4a95-8110-42d51d2ca7ee" (UID: "78e13f3d-4713-4a95-8110-42d51d2ca7ee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:36:06.835109 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.835090    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78e13f3d-4713-4a95-8110-42d51d2ca7ee-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:06.836721 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.836702    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78e13f3d-4713-4a95-8110-42d51d2ca7ee-kube-api-access-w5v7z" pod "78e13f3d-4713-4a95-8110-42d51d2ca7ee" (UID: "78e13f3d-4713-4a95-8110-42d51d2ca7ee"). InnerVolumeSpecName "kube-api-access-w5v7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:06.850836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.850790    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:36:06.936096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.936052    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-plugins-config-volume\") pod \"831a6d20-0dfb-489e-9a03-f5cdc918fe9d\" (UID: \"831a6d20-0dfb-489e-9a03-f5cdc918fe9d\") "
Oct 30 20:36:06.936320 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.936112    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-kube-api-access-lpqhn\" (UniqueName: \"kubernetes.io/projected/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-kube-api-access-lpqhn\") pod \"831a6d20-0dfb-489e-9a03-f5cdc918fe9d\" (UID: \"831a6d20-0dfb-489e-9a03-f5cdc918fe9d\") "
Oct 30 20:36:06.936493 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.936469    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-plugins-config-volume" pod "831a6d20-0dfb-489e-9a03-f5cdc918fe9d" (UID: "831a6d20-0dfb-489e-9a03-f5cdc918fe9d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:36:06.936602 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.936585    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:06.936669 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.936605    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5v7z\" (UniqueName: \"kubernetes.io/projected/78e13f3d-4713-4a95-8110-42d51d2ca7ee-kube-api-access-w5v7z\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:06.938655 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:06.938618    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-kube-api-access-lpqhn" pod "831a6d20-0dfb-489e-9a03-f5cdc918fe9d" (UID: "831a6d20-0dfb-489e-9a03-f5cdc918fe9d"). InnerVolumeSpecName "kube-api-access-lpqhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:07.040406 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.040275    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpqhn\" (UniqueName: \"kubernetes.io/projected/831a6d20-0dfb-489e-9a03-f5cdc918fe9d-kube-api-access-lpqhn\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:07.135397 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.135360    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:07.380229 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.380189    6015 generic.go:356] "Generic (PLEG): container finished" podID="78e13f3d-4713-4a95-8110-42d51d2ca7ee" containerID="aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99" exitCode=0
Oct 30 20:36:07.380658 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.380235    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"
Oct 30 20:36:07.380658 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.380274    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx" event={"ID":"78e13f3d-4713-4a95-8110-42d51d2ca7ee","Type":"ContainerDied","Data":"aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99"}
Oct 30 20:36:07.380658 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.380333    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx" event={"ID":"78e13f3d-4713-4a95-8110-42d51d2ca7ee","Type":"ContainerDied","Data":"7216810c0d1ec0a601b0ac9460e03a18bf58441c1d4867a2e407e50fb5d70e2d"}
Oct 30 20:36:07.380658 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.380367    6015 scope.go:122] "RemoveContainer" containerID="aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99"
Oct 30 20:36:07.381663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.381643    6015 generic.go:356] "Generic (PLEG): container finished" podID="831a6d20-0dfb-489e-9a03-f5cdc918fe9d" containerID="e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d" exitCode=0
Oct 30 20:36:07.381787 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.381694    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"
Oct 30 20:36:07.381787 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.381725    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7" event={"ID":"831a6d20-0dfb-489e-9a03-f5cdc918fe9d","Type":"ContainerDied","Data":"e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d"}
Oct 30 20:36:07.381787 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.381782    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7" event={"ID":"831a6d20-0dfb-489e-9a03-f5cdc918fe9d","Type":"ContainerDied","Data":"e6a9fee8c5369b48bb9f63c4e500a514cc2945e376137f259618ea46770c5a16"}
Oct 30 20:36:07.395517 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.395466    6015 scope.go:122] "RemoveContainer" containerID="aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99"
Oct 30 20:36:07.395955 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:07.395931    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99\": container with ID starting with aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99 not found: ID does not exist" containerID="aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99"
Oct 30 20:36:07.396071 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.395967    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99"} err="failed to get container status \"aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99\": rpc error: code = NotFound desc = could not find container \"aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99\": container with ID starting with aed073fa3952dc7e1ef11bce0d2c4c7a88a4e3598987e0391db3f791c029ed99 not found: ID does not exist"
Oct 30 20:36:07.396071 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.395990    6015 scope.go:122] "RemoveContainer" containerID="e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d"
Oct 30 20:36:07.405295 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.405278    6015 scope.go:122] "RemoveContainer" containerID="e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d"
Oct 30 20:36:07.405561 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:07.405543    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d\": container with ID starting with e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d not found: ID does not exist" containerID="e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d"
Oct 30 20:36:07.405627 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.405573    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d"} err="failed to get container status \"e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d\": rpc error: code = NotFound desc = could not find container \"e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d\": container with ID starting with e9ff8ec7c08c66d5f1d2136a3a635aed7a12d859551a2c51af100773166dcf9d not found: ID does not exist"
Oct 30 20:36:07.538895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.538860    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"]
Oct 30 20:36:07.542682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.542652    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-e391de-84648dcdf6-4vwmx"]
Oct 30 20:36:07.586164 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.586133    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="78e13f3d-4713-4a95-8110-42d51d2ca7ee" path="/var/lib/kubelet/pods/78e13f3d-4713-4a95-8110-42d51d2ca7ee/volumes"
Oct 30 20:36:07.651132 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.651042    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"]
Oct 30 20:36:07.659749 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:07.659716    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-e391de-8bdcff79f-gpxx7"]
Oct 30 20:36:09.591695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.591613    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="831a6d20-0dfb-489e-9a03-f5cdc918fe9d" path="/var/lib/kubelet/pods/831a6d20-0dfb-489e-9a03-f5cdc918fe9d/volumes"
Oct 30 20:36:09.630730 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.630701    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 20:36:09.672278 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.672238    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0abbe2cc-d0e2-4504-893c-698a1e1c246c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0abbe2cc-d0e2-4504-893c-698a1e1c246c-plugins-config-volume\") pod \"0abbe2cc-d0e2-4504-893c-698a1e1c246c\" (UID: \"0abbe2cc-d0e2-4504-893c-698a1e1c246c\") "
Oct 30 20:36:09.672469 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.672448    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0abbe2cc-d0e2-4504-893c-698a1e1c246c-kube-api-access-sgrn6\" (UniqueName: \"kubernetes.io/projected/0abbe2cc-d0e2-4504-893c-698a1e1c246c-kube-api-access-sgrn6\") pod \"0abbe2cc-d0e2-4504-893c-698a1e1c246c\" (UID: \"0abbe2cc-d0e2-4504-893c-698a1e1c246c\") "
Oct 30 20:36:09.672730 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.672697    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0abbe2cc-d0e2-4504-893c-698a1e1c246c-plugins-config-volume" pod "0abbe2cc-d0e2-4504-893c-698a1e1c246c" (UID: "0abbe2cc-d0e2-4504-893c-698a1e1c246c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:36:09.672941 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.672919    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0abbe2cc-d0e2-4504-893c-698a1e1c246c-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:09.674904 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.674879    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0abbe2cc-d0e2-4504-893c-698a1e1c246c-kube-api-access-sgrn6" pod "0abbe2cc-d0e2-4504-893c-698a1e1c246c" (UID: "0abbe2cc-d0e2-4504-893c-698a1e1c246c"). InnerVolumeSpecName "kube-api-access-sgrn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:09.697693 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.697641    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:09.740881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.740855    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 20:36:09.773798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.773756    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b54a968f-61c5-4a4f-a7b1-6764c5828d89-kube-api-access-s6dr9\" (UniqueName: \"kubernetes.io/projected/b54a968f-61c5-4a4f-a7b1-6764c5828d89-kube-api-access-s6dr9\") pod \"b54a968f-61c5-4a4f-a7b1-6764c5828d89\" (UID: \"b54a968f-61c5-4a4f-a7b1-6764c5828d89\") "
Oct 30 20:36:09.774049 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.773892    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b54a968f-61c5-4a4f-a7b1-6764c5828d89-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54a968f-61c5-4a4f-a7b1-6764c5828d89-plugins-config-volume\") pod \"b54a968f-61c5-4a4f-a7b1-6764c5828d89\" (UID: \"b54a968f-61c5-4a4f-a7b1-6764c5828d89\") "
Oct 30 20:36:09.774299 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.774274    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b54a968f-61c5-4a4f-a7b1-6764c5828d89-plugins-config-volume" pod "b54a968f-61c5-4a4f-a7b1-6764c5828d89" (UID: "b54a968f-61c5-4a4f-a7b1-6764c5828d89"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:36:09.774387 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.774360    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgrn6\" (UniqueName: \"kubernetes.io/projected/0abbe2cc-d0e2-4504-893c-698a1e1c246c-kube-api-access-sgrn6\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:09.776308 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.776282    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b54a968f-61c5-4a4f-a7b1-6764c5828d89-kube-api-access-s6dr9" pod "b54a968f-61c5-4a4f-a7b1-6764c5828d89" (UID: "b54a968f-61c5-4a4f-a7b1-6764c5828d89"). InnerVolumeSpecName "kube-api-access-s6dr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:09.875903 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.875786    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6dr9\" (UniqueName: \"kubernetes.io/projected/b54a968f-61c5-4a4f-a7b1-6764c5828d89-kube-api-access-s6dr9\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:09.875903 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:09.875849    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54a968f-61c5-4a4f-a7b1-6764c5828d89-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:10.405187 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.405154    6015 generic.go:356] "Generic (PLEG): container finished" podID="0abbe2cc-d0e2-4504-893c-698a1e1c246c" containerID="0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5" exitCode=0
Oct 30 20:36:10.405386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.405198    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"
Oct 30 20:36:10.405386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.405246    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4" event={"ID":"0abbe2cc-d0e2-4504-893c-698a1e1c246c","Type":"ContainerDied","Data":"0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5"}
Oct 30 20:36:10.405386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.405294    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4" event={"ID":"0abbe2cc-d0e2-4504-893c-698a1e1c246c","Type":"ContainerDied","Data":"ec9af8b33c054becb714279cfba187394f07243f5c696616a5b9ffcc4720d4e4"}
Oct 30 20:36:10.405386 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.405323    6015 scope.go:122] "RemoveContainer" containerID="0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5"
Oct 30 20:36:10.406784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.406764    6015 generic.go:356] "Generic (PLEG): container finished" podID="b54a968f-61c5-4a4f-a7b1-6764c5828d89" containerID="4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24" exitCode=0
Oct 30 20:36:10.406929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.406798    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"
Oct 30 20:36:10.406929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.406837    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57" event={"ID":"b54a968f-61c5-4a4f-a7b1-6764c5828d89","Type":"ContainerDied","Data":"4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24"}
Oct 30 20:36:10.406929 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.406879    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57" event={"ID":"b54a968f-61c5-4a4f-a7b1-6764c5828d89","Type":"ContainerDied","Data":"6b2a26d61a8aa89a9fb333a9837566ef8938c0860e2348f32a1fe7d58f97ad23"}
Oct 30 20:36:10.421479 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.421451    6015 scope.go:122] "RemoveContainer" containerID="0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5"
Oct 30 20:36:10.422108 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:10.422075    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5\": container with ID starting with 0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5 not found: ID does not exist" containerID="0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5"
Oct 30 20:36:10.422223 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.422123    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5"} err="failed to get container status \"0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5\": rpc error: code = NotFound desc = could not find container \"0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5\": container with ID starting with 0154b67b68c521ebf0d58f7e559e011e7913768249bd2cfec763167fc7551fc5 not found: ID does not exist"
Oct 30 20:36:10.422223 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.422151    6015 scope.go:122] "RemoveContainer" containerID="4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24"
Oct 30 20:36:10.432672 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.432651    6015 scope.go:122] "RemoveContainer" containerID="4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24"
Oct 30 20:36:10.433042 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:10.433021    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24\": container with ID starting with 4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24 not found: ID does not exist" containerID="4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24"
Oct 30 20:36:10.433132 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.433050    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24"} err="failed to get container status \"4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24\": rpc error: code = NotFound desc = could not find container \"4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24\": container with ID starting with 4095e82eb6161657dd1fad33030a797f254f78c47f41412ad92dd1ba6551fd24 not found: ID does not exist"
Oct 30 20:36:10.568442 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.568402    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"]
Oct 30 20:36:10.613878 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.613778    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-4ec609-697d4579cf-w5v57"]
Oct 30 20:36:10.741438 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.741402    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"]
Oct 30 20:36:10.751231 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:10.751201    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4ec609-f6cc8cb56-ckdc4"]
Oct 30 20:36:11.467742 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.467704    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:11.586990 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.586960    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0abbe2cc-d0e2-4504-893c-698a1e1c246c" path="/var/lib/kubelet/pods/0abbe2cc-d0e2-4504-893c-698a1e1c246c/volumes"
Oct 30 20:36:11.587861 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.587800    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b54a968f-61c5-4a4f-a7b1-6764c5828d89" path="/var/lib/kubelet/pods/b54a968f-61c5-4a4f-a7b1-6764c5828d89/volumes"
Oct 30 20:36:11.734431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.734336    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:11.839963 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.839934    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:36:11.885342 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.885305    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:11.899721 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.899687    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/887c8955-1084-476d-bd4f-80b005dc02b4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/887c8955-1084-476d-bd4f-80b005dc02b4-istio-podinfo\") pod \"887c8955-1084-476d-bd4f-80b005dc02b4\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") "
Oct 30 20:36:11.899954 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.899737    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/887c8955-1084-476d-bd4f-80b005dc02b4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/887c8955-1084-476d-bd4f-80b005dc02b4-istiod-ca-cert\") pod \"887c8955-1084-476d-bd4f-80b005dc02b4\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") "
Oct 30 20:36:11.899954 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.899781    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-credential-socket\") pod \"887c8955-1084-476d-bd4f-80b005dc02b4\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") "
Oct 30 20:36:11.899954 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.899869    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-data\") pod \"887c8955-1084-476d-bd4f-80b005dc02b4\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") "
Oct 30 20:36:11.899954 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.899912    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-istio-token\" (UniqueName: \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-istio-token\") pod \"887c8955-1084-476d-bd4f-80b005dc02b4\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") "
Oct 30 20:36:11.900285 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900036    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-certs\") pod \"887c8955-1084-476d-bd4f-80b005dc02b4\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") "
Oct 30 20:36:11.900285 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900166    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-kube-api-access-vj5n2\" (UniqueName: \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-kube-api-access-vj5n2\") pod \"887c8955-1084-476d-bd4f-80b005dc02b4\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") "
Oct 30 20:36:11.900285 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900203    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-envoy\") pod \"887c8955-1084-476d-bd4f-80b005dc02b4\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") "
Oct 30 20:36:11.900285 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900234    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-socket\") pod \"887c8955-1084-476d-bd4f-80b005dc02b4\" (UID: \"887c8955-1084-476d-bd4f-80b005dc02b4\") "
Oct 30 20:36:11.900285 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900251    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-data" pod "887c8955-1084-476d-bd4f-80b005dc02b4" (UID: "887c8955-1084-476d-bd4f-80b005dc02b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:11.900540 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900357    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-certs" pod "887c8955-1084-476d-bd4f-80b005dc02b4" (UID: "887c8955-1084-476d-bd4f-80b005dc02b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:11.900540 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900388    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/887c8955-1084-476d-bd4f-80b005dc02b4-istiod-ca-cert" pod "887c8955-1084-476d-bd4f-80b005dc02b4" (UID: "887c8955-1084-476d-bd4f-80b005dc02b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:36:11.900645 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900563    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-socket" pod "887c8955-1084-476d-bd4f-80b005dc02b4" (UID: "887c8955-1084-476d-bd4f-80b005dc02b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:11.900703 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900660    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-credential-socket" pod "887c8955-1084-476d-bd4f-80b005dc02b4" (UID: "887c8955-1084-476d-bd4f-80b005dc02b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:11.900788 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900759    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:11.900888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900784    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:11.900888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900800    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/887c8955-1084-476d-bd4f-80b005dc02b4-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:11.900888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900853    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:11.900888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.900867    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:11.902954 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.902927    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/887c8955-1084-476d-bd4f-80b005dc02b4-istio-podinfo" pod "887c8955-1084-476d-bd4f-80b005dc02b4" (UID: "887c8955-1084-476d-bd4f-80b005dc02b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:36:11.903077 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.903052    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-envoy" pod "887c8955-1084-476d-bd4f-80b005dc02b4" (UID: "887c8955-1084-476d-bd4f-80b005dc02b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:11.903566 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.903536    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-istio-token" pod "887c8955-1084-476d-bd4f-80b005dc02b4" (UID: "887c8955-1084-476d-bd4f-80b005dc02b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:11.903852 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:11.903824    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-kube-api-access-vj5n2" pod "887c8955-1084-476d-bd4f-80b005dc02b4" (UID: "887c8955-1084-476d-bd4f-80b005dc02b4"). InnerVolumeSpecName "kube-api-access-vj5n2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:12.002395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.002307    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/887c8955-1084-476d-bd4f-80b005dc02b4-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:12.002395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.002341    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:12.002395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.002350    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj5n2\" (UniqueName: \"kubernetes.io/projected/887c8955-1084-476d-bd4f-80b005dc02b4-kube-api-access-vj5n2\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:12.002395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.002360    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/887c8955-1084-476d-bd4f-80b005dc02b4-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:12.245444 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.245406    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:12.425344 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.425308    6015 generic.go:356] "Generic (PLEG): container finished" podID="887c8955-1084-476d-bd4f-80b005dc02b4" containerID="00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff" exitCode=0
Oct 30 20:36:12.425536 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.425357    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"
Oct 30 20:36:12.425536 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.425392    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" event={"ID":"887c8955-1084-476d-bd4f-80b005dc02b4","Type":"ContainerDied","Data":"00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff"}
Oct 30 20:36:12.425536 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.425450    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd" event={"ID":"887c8955-1084-476d-bd4f-80b005dc02b4","Type":"ContainerDied","Data":"ff02d88caaba50b4fb1661cefc9e9b3c3e458b956fa2a2c0930e985c68a16e04"}
Oct 30 20:36:12.425536 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.425475    6015 scope.go:122] "RemoveContainer" containerID="00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff"
Oct 30 20:36:12.434142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.434115    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:12.437116 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.437091    6015 scope.go:122] "RemoveContainer" containerID="5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58"
Oct 30 20:36:12.446645 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.446626    6015 scope.go:122] "RemoveContainer" containerID="00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff"
Oct 30 20:36:12.447023 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:12.447003    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff\": container with ID starting with 00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff not found: ID does not exist" containerID="00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff"
Oct 30 20:36:12.447083 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.447034    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff"} err="failed to get container status \"00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff\": rpc error: code = NotFound desc = could not find container \"00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff\": container with ID starting with 00cc6d0863c4653192b8639c50dd23275026d427e1092ade1727b8c0576bf9ff not found: ID does not exist"
Oct 30 20:36:12.447083 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.447053    6015 scope.go:122] "RemoveContainer" containerID="5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58"
Oct 30 20:36:12.447342 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:12.447320    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58\": container with ID starting with 5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58 not found: ID does not exist" containerID="5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58"
Oct 30 20:36:12.447402 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.447348    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58"} err="failed to get container status \"5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58\": rpc error: code = NotFound desc = could not find container \"5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58\": container with ID starting with 5cc2888f6850cf4412f21ee5c00fd8f579a0bb705240b9ecc32e163733341c58 not found: ID does not exist"
Oct 30 20:36:12.584483 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.584443    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"]
Oct 30 20:36:12.588088 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:12.588057    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-fe49e7-openshift-default-9c8d6658c-x5vkd"]
Oct 30 20:36:13.589398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:13.589359    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" path="/var/lib/kubelet/pods/887c8955-1084-476d-bd4f-80b005dc02b4/volumes"
Oct 30 20:36:15.466859 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:15.466820    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:15.623699 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:15.623660    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:17.503580 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:17.503488    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:19.508752 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:19.508714    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:19.724877 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:19.724845    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:19.880461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:19.880419    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:20.141486 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:20.141383    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"]
Oct 30 20:36:20.141677 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:20.141646    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy" containerID="cri-o://1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e" gracePeriod=30
Oct 30 20:36:20.158317 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:20.158276    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:20.631592 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:20.631553    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:22.329402 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:22.329361    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:22.484917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:22.484874    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:22.754496 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:22.754388    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:25.414009 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.413933    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:36:25.469302 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469264    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-podinfo\") pod \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") "
Oct 30 20:36:25.469513 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469384    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-credential-socket\") pod \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") "
Oct 30 20:36:25.469513 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469441    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-socket\") pod \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") "
Oct 30 20:36:25.469513 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469485    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istiod-ca-cert\") pod \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") "
Oct 30 20:36:25.469678 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469521    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-data\") pod \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") "
Oct 30 20:36:25.469678 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469616    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-token\" (UniqueName: \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-token\") pod \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") "
Oct 30 20:36:25.469791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469690    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-certs\") pod \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") "
Oct 30 20:36:25.469791 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469744    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-envoy\") pod \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") "
Oct 30 20:36:25.469939 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469798    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-kube-api-access-cncdr\" (UniqueName: \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-kube-api-access-cncdr\") pod \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\" (UID: \"4ef4ad1c-72c9-4faf-9894-665936b7dc51\") "
Oct 30 20:36:25.469939 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469739    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-credential-socket" pod "4ef4ad1c-72c9-4faf-9894-665936b7dc51" (UID: "4ef4ad1c-72c9-4faf-9894-665936b7dc51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:25.469939 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469921    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istiod-ca-cert" pod "4ef4ad1c-72c9-4faf-9894-665936b7dc51" (UID: "4ef4ad1c-72c9-4faf-9894-665936b7dc51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:36:25.470101 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.469850    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-data" pod "4ef4ad1c-72c9-4faf-9894-665936b7dc51" (UID: "4ef4ad1c-72c9-4faf-9894-665936b7dc51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:25.470101 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.470025    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-certs" pod "4ef4ad1c-72c9-4faf-9894-665936b7dc51" (UID: "4ef4ad1c-72c9-4faf-9894-665936b7dc51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:25.470561 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.470540    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:25.470648 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.470566    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:25.470648 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.470581    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:25.470648 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.470596    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:25.470890 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.470727    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-socket" pod "4ef4ad1c-72c9-4faf-9894-665936b7dc51" (UID: "4ef4ad1c-72c9-4faf-9894-665936b7dc51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:25.472078 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.472046    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-envoy" pod "4ef4ad1c-72c9-4faf-9894-665936b7dc51" (UID: "4ef4ad1c-72c9-4faf-9894-665936b7dc51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:25.472210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.472158    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-kube-api-access-cncdr" pod "4ef4ad1c-72c9-4faf-9894-665936b7dc51" (UID: "4ef4ad1c-72c9-4faf-9894-665936b7dc51"). InnerVolumeSpecName "kube-api-access-cncdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:25.472276 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.472249    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-podinfo" pod "4ef4ad1c-72c9-4faf-9894-665936b7dc51" (UID: "4ef4ad1c-72c9-4faf-9894-665936b7dc51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:36:25.472591 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.472575    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-token" pod "4ef4ad1c-72c9-4faf-9894-665936b7dc51" (UID: "4ef4ad1c-72c9-4faf-9894-665936b7dc51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:25.515511 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.515480    6015 generic.go:356] "Generic (PLEG): container finished" podID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerID="1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e" exitCode=0
Oct 30 20:36:25.515676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.515531    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"
Oct 30 20:36:25.515676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.515566    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" event={"ID":"4ef4ad1c-72c9-4faf-9894-665936b7dc51","Type":"ContainerDied","Data":"1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e"}
Oct 30 20:36:25.515676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.515626    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5" event={"ID":"4ef4ad1c-72c9-4faf-9894-665936b7dc51","Type":"ContainerDied","Data":"3dc4f48eeb35c2e121307459f8f0167fe2c42e4f88828b8d39014e910cf4763f"}
Oct 30 20:36:25.515676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.515652    6015 scope.go:122] "RemoveContainer" containerID="1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e"
Oct 30 20:36:25.527327 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.527297    6015 scope.go:122] "RemoveContainer" containerID="11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc"
Oct 30 20:36:25.537368 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.537345    6015 scope.go:122] "RemoveContainer" containerID="1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e"
Oct 30 20:36:25.537686 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:25.537663    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e\": container with ID starting with 1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e not found: ID does not exist" containerID="1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e"
Oct 30 20:36:25.537782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.537701    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e"} err="failed to get container status \"1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e\": rpc error: code = NotFound desc = could not find container \"1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e\": container with ID starting with 1b44d2a2f66946645ea0e38270e7ce6c283c9c262e9a30ad7a9566dffe12c77e not found: ID does not exist"
Oct 30 20:36:25.537782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.537727    6015 scope.go:122] "RemoveContainer" containerID="11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc"
Oct 30 20:36:25.537999 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:25.537980    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc\": container with ID starting with 11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc not found: ID does not exist" containerID="11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc"
Oct 30 20:36:25.538055 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.538006    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc"} err="failed to get container status \"11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc\": rpc error: code = NotFound desc = could not find container \"11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc\": container with ID starting with 11db68cd680d77827240b750460f62eedb36721100c0cbc9d7d60ff728db3bcc not found: ID does not exist"
Oct 30 20:36:25.571677 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.571640    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:25.571677 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.571670    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:25.571677 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.571681    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cncdr\" (UniqueName: \"kubernetes.io/projected/4ef4ad1c-72c9-4faf-9894-665936b7dc51-kube-api-access-cncdr\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:25.572054 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.571692    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ef4ad1c-72c9-4faf-9894-665936b7dc51-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:25.572054 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.571705    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef4ad1c-72c9-4faf-9894-665936b7dc51-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:25.628474 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.628420    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"]
Oct 30 20:36:25.630426 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.630385    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"]
Oct 30 20:36:25.632954 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.632925    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"]
Oct 30 20:36:25.688427 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.688335    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"]
Oct 30 20:36:25.693549 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.693518    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-b37684-openshift-default-76d9679d6c-bxcc5"]
Oct 30 20:36:25.754138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:25.754101    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:27.585067 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:27.585027    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" path="/var/lib/kubelet/pods/4ef4ad1c-72c9-4faf-9894-665936b7dc51/volumes"
Oct 30 20:36:27.902732 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:27.902632    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:28.216767 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:28.216677    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:36:32.926779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:32.926740    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:35.193832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:35.192189    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"]
Oct 30 20:36:35.448385 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:35.448254    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:35.683305 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:35.683268    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:35.861285 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:35.861242    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:37.182855 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.182794    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:37.661993 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.661963    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"]
Oct 30 20:36:37.662525 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662511    6015 cpu_manager.go:414] "containerMap: removing container" podUID="d132ed73-6a9c-4be9-8682-ec854f7b5300" containerName="main"
Oct 30 20:36:37.662575 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662527    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d132ed73-6a9c-4be9-8682-ec854f7b5300" containerName="main"
Oct 30 20:36:37.662575 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662542    6015 cpu_manager.go:414] "containerMap: removing container" podUID="da1ce8df-cc26-42d7-a76d-b5d63110521a" containerName="payload-processing"
Oct 30 20:36:37.662575 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662548    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da1ce8df-cc26-42d7-a76d-b5d63110521a" containerName="payload-processing"
Oct 30 20:36:37.662575 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662557    6015 cpu_manager.go:414] "containerMap: removing container" podUID="2b05030d-6dbd-4f36-9304-cf5cd028b99d" containerName="payload-pre-processing"
Oct 30 20:36:37.662575 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662562    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b05030d-6dbd-4f36-9304-cf5cd028b99d" containerName="payload-pre-processing"
Oct 30 20:36:37.662575 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662573    6015 cpu_manager.go:414] "containerMap: removing container" podUID="179f17ce-6608-4f79-9c5a-e675719d5bef" containerName="main"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662578    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="179f17ce-6608-4f79-9c5a-e675719d5bef" containerName="main"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662598    6015 cpu_manager.go:414] "containerMap: removing container" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662612    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662619    6015 cpu_manager.go:414] "containerMap: removing container" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662624    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662631    6015 cpu_manager.go:414] "containerMap: removing container" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662636    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662644    6015 cpu_manager.go:414] "containerMap: removing container" podUID="831a6d20-0dfb-489e-9a03-f5cdc918fe9d" containerName="payload-pre-processing"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662649    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="831a6d20-0dfb-489e-9a03-f5cdc918fe9d" containerName="payload-pre-processing"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662657    6015 cpu_manager.go:414] "containerMap: removing container" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662662    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662668    6015 cpu_manager.go:414] "containerMap: removing container" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662672    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662683    6015 cpu_manager.go:414] "containerMap: removing container" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662688    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662705    6015 cpu_manager.go:414] "containerMap: removing container" podUID="78e13f3d-4713-4a95-8110-42d51d2ca7ee" containerName="payload-processing"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662709    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="78e13f3d-4713-4a95-8110-42d51d2ca7ee" containerName="payload-processing"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662717    6015 cpu_manager.go:414] "containerMap: removing container" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662722    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662734    6015 cpu_manager.go:414] "containerMap: removing container" podUID="b54a968f-61c5-4a4f-a7b1-6764c5828d89" containerName="payload-pre-processing"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662740    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b54a968f-61c5-4a4f-a7b1-6764c5828d89" containerName="payload-pre-processing"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662760    6015 cpu_manager.go:414] "containerMap: removing container" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662767    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy"
Oct 30 20:36:37.662798 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662778    6015 cpu_manager.go:414] "containerMap: removing container" podUID="f267cd16-d777-4f24-b0b9-ba709966d733" containerName="revoke-keys"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662784    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f267cd16-d777-4f24-b0b9-ba709966d733" containerName="revoke-keys"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662867    6015 cpu_manager.go:414] "containerMap: removing container" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662876    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662894    6015 cpu_manager.go:414] "containerMap: removing container" podUID="0abbe2cc-d0e2-4504-893c-698a1e1c246c" containerName="payload-processing"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662901    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0abbe2cc-d0e2-4504-893c-698a1e1c246c" containerName="payload-processing"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662931    6015 cpu_manager.go:414] "containerMap: removing container" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.662937    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663049    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663059    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663064    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="afc16ca4-a83c-41aa-8853-5bb0ec6d58e5" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663074    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="78e13f3d-4713-4a95-8110-42d51d2ca7ee" containerName="payload-processing"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663081    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="887c8955-1084-476d-bd4f-80b005dc02b4" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663090    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="b54a968f-61c5-4a4f-a7b1-6764c5828d89" containerName="payload-pre-processing"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663098    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663105    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="f267cd16-d777-4f24-b0b9-ba709966d733" containerName="revoke-keys"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663110    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663115    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="0abbe2cc-d0e2-4504-893c-698a1e1c246c" containerName="payload-processing"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663122    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="41109844-dc57-4bb7-a1db-719717d9cbb9" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663128    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="d132ed73-6a9c-4be9-8682-ec854f7b5300" containerName="main"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663134    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="da1ce8df-cc26-42d7-a76d-b5d63110521a" containerName="payload-processing"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663138    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b05030d-6dbd-4f36-9304-cf5cd028b99d" containerName="payload-pre-processing"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663143    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="179f17ce-6608-4f79-9c5a-e675719d5bef" containerName="main"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663151    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663156    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="05b24513-c127-49cf-a507-735fe4e47192" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663161    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="4ef4ad1c-72c9-4faf-9894-665936b7dc51" containerName="istio-proxy"
Oct 30 20:36:37.663716 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.663166    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="831a6d20-0dfb-489e-9a03-f5cdc918fe9d" containerName="payload-pre-processing"
Oct 30 20:36:37.690847 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.690436    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.745211 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.745174    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-273c1b-openshift-default-dockercfg-vkwfn\""
Oct 30 20:36:37.753464 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.753426    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xxcg\" (UniqueName: \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-kube-api-access-5xxcg\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.753672 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.753524    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-data\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.753672 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.753638    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-envoy\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.753672 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.753661    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-socket\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.753892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.753690    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/696e031c-3499-48ce-a9dd-dc02da84d95e-istiod-ca-cert\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.753892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.753733    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-credential-socket\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.753892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.753773    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-podinfo\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.753892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.753794    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-token\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.753892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.753878    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-certs\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.787923 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.785019    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:37.798774 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.798729    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"]
Oct 30 20:36:37.855065 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855027    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-envoy\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.855065 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855071    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-socket\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.855343 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855102    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/696e031c-3499-48ce-a9dd-dc02da84d95e-istiod-ca-cert\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.855343 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855160    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-credential-socket\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.855343 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855208    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-podinfo\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.855343 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855232    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-token\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.855692 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855539    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-socket\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.855692 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855669    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-credential-socket\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.855893 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855673    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-certs\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.855893 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855773    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xxcg\" (UniqueName: \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-kube-api-access-5xxcg\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.856027 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855945    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/696e031c-3499-48ce-a9dd-dc02da84d95e-istiod-ca-cert\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.856027 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.855972    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-certs\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.856259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.856234    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-data\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.856557 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.856534    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-data\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.857841 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.857792    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-envoy\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.858093 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.858075    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-podinfo\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.917542 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.917467    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xxcg\" (UniqueName: \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-kube-api-access-5xxcg\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.917682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.917626    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-token\") pod \"e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") " pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:37.982683 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:37.982635    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:38.034180 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:38.034149    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:38.290782 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:38.290681    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:38.478134 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:38.478082    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"]
Oct 30 20:36:38.483516 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:36:38.483480    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696e031c_3499_48ce_a9dd_dc02da84d95e.slice/crio-fe5c6d2e6508e7ed78193f7db26a88b0eaaf7ff3926bc0148038a9f908f2f7f7 WatchSource:0}: Error finding container fe5c6d2e6508e7ed78193f7db26a88b0eaaf7ff3926bc0148038a9f908f2f7f7: Status 404 returned error can't find the container with id fe5c6d2e6508e7ed78193f7db26a88b0eaaf7ff3926bc0148038a9f908f2f7f7
Oct 30 20:36:38.486212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:38.486172    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:36:38.486321 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:38.486255    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:36:38.486321 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:38.486284    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:36:38.634891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:38.632379    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" event={"ID":"696e031c-3499-48ce-a9dd-dc02da84d95e","Type":"ContainerStarted","Data":"9c1d8f36988fa93a42cf9a510445ec08422f17a9da79ef0a4a64b3632c8b0151"}
Oct 30 20:36:38.634891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:38.632442    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" event={"ID":"696e031c-3499-48ce-a9dd-dc02da84d95e","Type":"ContainerStarted","Data":"fe5c6d2e6508e7ed78193f7db26a88b0eaaf7ff3926bc0148038a9f908f2f7f7"}
Oct 30 20:36:38.750076 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:38.750017    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" podStartSLOduration=1.749995324 podStartE2EDuration="1.749995324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:38.747836774 +0000 UTC m=+4261.290644050" watchObservedRunningTime="2026-10-30 20:36:38.749995324 +0000 UTC m=+4261.292802591"
Oct 30 20:36:39.034639 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:39.034549    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:39.040924 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:39.040892    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:39.148272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:39.148234    6015 scope.go:122] "RemoveContainer" containerID="3a889b947834f3623929a2a3a63e7e868f532091f3494b66c4f98d04093707cb"
Oct 30 20:36:39.640654 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:39.640625    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:39.641789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:39.641763    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:36:40.192706 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:40.192642    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v" podUID="3e8dca38-1009-42b6-b5e4-e635ba755eaa" containerName="payload-pre-processing" containerID="cri-o://5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006" gracePeriod=25
Oct 30 20:36:40.650953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:40.650911    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" podUID="6c4a770e-321c-4c47-93dc-2ebff03fb985" containerName="main" containerID="cri-o://469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8" gracePeriod=45
Oct 30 20:36:40.651438 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:40.651234    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" podUID="032b436b-bd82-4e71-a709-c58ce8cbf72e" containerName="main" containerID="cri-o://07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91" gracePeriod=45
Oct 30 20:36:40.652928 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:40.652882    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerName="main" containerID="cri-o://d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784" gracePeriod=45
Oct 30 20:36:40.743059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:40.743019    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": dial tcp 10.134.0.55:8000: connect: connection refused"
Oct 30 20:36:41.012144 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.012109    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 20:36:41.019574 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.019545    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 20:36:41.024303 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.024245    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 20:36:41.107649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.107574    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/032b436b-bd82-4e71-a709-c58ce8cbf72e-tls-certs\" (UniqueName: \"kubernetes.io/secret/032b436b-bd82-4e71-a709-c58ce8cbf72e-tls-certs\") pod \"032b436b-bd82-4e71-a709-c58ce8cbf72e\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") "
Oct 30 20:36:41.107649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.107642    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c4a770e-321c-4c47-93dc-2ebff03fb985-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4a770e-321c-4c47-93dc-2ebff03fb985-tls-certs\") pod \"6c4a770e-321c-4c47-93dc-2ebff03fb985\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.107759    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-dshm\") pod \"032b436b-bd82-4e71-a709-c58ce8cbf72e\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.107839    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-tmp-dir\") pod \"032b436b-bd82-4e71-a709-c58ce8cbf72e\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.107903    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-dshm\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-dshm\") pod \"444d7fc5-1339-416f-b734-585f2c7ddb04\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.107949    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/444d7fc5-1339-416f-b734-585f2c7ddb04-tls-certs\" (UniqueName: \"kubernetes.io/secret/444d7fc5-1339-416f-b734-585f2c7ddb04-tls-certs\") pod \"444d7fc5-1339-416f-b734-585f2c7ddb04\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.107994    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-home\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-home\") pod \"444d7fc5-1339-416f-b734-585f2c7ddb04\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108026    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/444d7fc5-1339-416f-b734-585f2c7ddb04-kube-api-access-8hvdw\" (UniqueName: \"kubernetes.io/projected/444d7fc5-1339-416f-b734-585f2c7ddb04-kube-api-access-8hvdw\") pod \"444d7fc5-1339-416f-b734-585f2c7ddb04\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108058    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-home\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-home\") pod \"6c4a770e-321c-4c47-93dc-2ebff03fb985\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108117    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/032b436b-bd82-4e71-a709-c58ce8cbf72e-kube-api-access-wnnn7\" (UniqueName: \"kubernetes.io/projected/032b436b-bd82-4e71-a709-c58ce8cbf72e-kube-api-access-wnnn7\") pod \"032b436b-bd82-4e71-a709-c58ce8cbf72e\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108165    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-model-cache\") pod \"6c4a770e-321c-4c47-93dc-2ebff03fb985\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108203    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-model-cache\") pod \"032b436b-bd82-4e71-a709-c58ce8cbf72e\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108243    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-tmp-dir\") pod \"6c4a770e-321c-4c47-93dc-2ebff03fb985\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") "
Oct 30 20:36:41.108277 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108268    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c4a770e-321c-4c47-93dc-2ebff03fb985-kube-api-access-78wnj\" (UniqueName: \"kubernetes.io/projected/6c4a770e-321c-4c47-93dc-2ebff03fb985-kube-api-access-78wnj\") pod \"6c4a770e-321c-4c47-93dc-2ebff03fb985\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") "
Oct 30 20:36:41.109400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108323    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-home\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-home\") pod \"032b436b-bd82-4e71-a709-c58ce8cbf72e\" (UID: \"032b436b-bd82-4e71-a709-c58ce8cbf72e\") "
Oct 30 20:36:41.109400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108353    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-model-cache\") pod \"444d7fc5-1339-416f-b734-585f2c7ddb04\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") "
Oct 30 20:36:41.109400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108389    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-tmp-dir\") pod \"444d7fc5-1339-416f-b734-585f2c7ddb04\" (UID: \"444d7fc5-1339-416f-b734-585f2c7ddb04\") "
Oct 30 20:36:41.109400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108443    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-dshm\") pod \"6c4a770e-321c-4c47-93dc-2ebff03fb985\" (UID: \"6c4a770e-321c-4c47-93dc-2ebff03fb985\") "
Oct 30 20:36:41.109400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108617    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-home" pod "444d7fc5-1339-416f-b734-585f2c7ddb04" (UID: "444d7fc5-1339-416f-b734-585f2c7ddb04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.109400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.108993    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-tmp-dir" pod "032b436b-bd82-4e71-a709-c58ce8cbf72e" (UID: "032b436b-bd82-4e71-a709-c58ce8cbf72e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.109400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.109102    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.109400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.109120    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.109400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.109313    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-model-cache" pod "032b436b-bd82-4e71-a709-c58ce8cbf72e" (UID: "032b436b-bd82-4e71-a709-c58ce8cbf72e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.109912 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.109620    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-home" pod "6c4a770e-321c-4c47-93dc-2ebff03fb985" (UID: "6c4a770e-321c-4c47-93dc-2ebff03fb985"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.110476 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.110303    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-model-cache" pod "444d7fc5-1339-416f-b734-585f2c7ddb04" (UID: "444d7fc5-1339-416f-b734-585f2c7ddb04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.110476 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.110360    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-tmp-dir" pod "444d7fc5-1339-416f-b734-585f2c7ddb04" (UID: "444d7fc5-1339-416f-b734-585f2c7ddb04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.110631 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.110521    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-home" pod "032b436b-bd82-4e71-a709-c58ce8cbf72e" (UID: "032b436b-bd82-4e71-a709-c58ce8cbf72e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.110939 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.110899    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-model-cache" pod "6c4a770e-321c-4c47-93dc-2ebff03fb985" (UID: "6c4a770e-321c-4c47-93dc-2ebff03fb985"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.110939 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.110915    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-tmp-dir" pod "6c4a770e-321c-4c47-93dc-2ebff03fb985" (UID: "6c4a770e-321c-4c47-93dc-2ebff03fb985"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.112515 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.112488    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-dshm" pod "6c4a770e-321c-4c47-93dc-2ebff03fb985" (UID: "6c4a770e-321c-4c47-93dc-2ebff03fb985"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.113368 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.113344    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c4a770e-321c-4c47-93dc-2ebff03fb985-kube-api-access-78wnj" pod "6c4a770e-321c-4c47-93dc-2ebff03fb985" (UID: "6c4a770e-321c-4c47-93dc-2ebff03fb985"). InnerVolumeSpecName "kube-api-access-78wnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:41.114154 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.114127    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/444d7fc5-1339-416f-b734-585f2c7ddb04-tls-certs" pod "444d7fc5-1339-416f-b734-585f2c7ddb04" (UID: "444d7fc5-1339-416f-b734-585f2c7ddb04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:36:41.114265 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.114128    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-dshm" pod "032b436b-bd82-4e71-a709-c58ce8cbf72e" (UID: "032b436b-bd82-4e71-a709-c58ce8cbf72e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.114265 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.114194    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4a770e-321c-4c47-93dc-2ebff03fb985-tls-certs" pod "6c4a770e-321c-4c47-93dc-2ebff03fb985" (UID: "6c4a770e-321c-4c47-93dc-2ebff03fb985"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:36:41.114265 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.114229    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-dshm" pod "444d7fc5-1339-416f-b734-585f2c7ddb04" (UID: "444d7fc5-1339-416f-b734-585f2c7ddb04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:36:41.114397 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.114315    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032b436b-bd82-4e71-a709-c58ce8cbf72e-tls-certs" pod "032b436b-bd82-4e71-a709-c58ce8cbf72e" (UID: "032b436b-bd82-4e71-a709-c58ce8cbf72e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:36:41.114572 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.114550    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/032b436b-bd82-4e71-a709-c58ce8cbf72e-kube-api-access-wnnn7" pod "032b436b-bd82-4e71-a709-c58ce8cbf72e" (UID: "032b436b-bd82-4e71-a709-c58ce8cbf72e"). InnerVolumeSpecName "kube-api-access-wnnn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:41.115516 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.115497    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444d7fc5-1339-416f-b734-585f2c7ddb04-kube-api-access-8hvdw" pod "444d7fc5-1339-416f-b734-585f2c7ddb04" (UID: "444d7fc5-1339-416f-b734-585f2c7ddb04"). InnerVolumeSpecName "kube-api-access-8hvdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:41.210955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.210859    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.210955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.210901    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.210955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.210915    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.210955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.210930    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78wnj\" (UniqueName: \"kubernetes.io/projected/6c4a770e-321c-4c47-93dc-2ebff03fb985-kube-api-access-78wnj\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.210955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.210947    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.210955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.210960    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.211456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.210973    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.211456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.210987    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.211456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.211001    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/032b436b-bd82-4e71-a709-c58ce8cbf72e-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.211456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.211013    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4a770e-321c-4c47-93dc-2ebff03fb985-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.211456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.211025    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/032b436b-bd82-4e71-a709-c58ce8cbf72e-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.211456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.211037    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/444d7fc5-1339-416f-b734-585f2c7ddb04-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.211456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.211049    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/444d7fc5-1339-416f-b734-585f2c7ddb04-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.211456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.211062    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hvdw\" (UniqueName: \"kubernetes.io/projected/444d7fc5-1339-416f-b734-585f2c7ddb04-kube-api-access-8hvdw\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.211456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.211075    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4a770e-321c-4c47-93dc-2ebff03fb985-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.211456 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.211089    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnnn7\" (UniqueName: \"kubernetes.io/projected/032b436b-bd82-4e71-a709-c58ce8cbf72e-kube-api-access-wnnn7\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:41.404041 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.403993    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.169:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:36:41.404210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.404083    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.169:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:36:41.581250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.581213    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:41.653862 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.653828    6015 generic.go:356] "Generic (PLEG): container finished" podID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerID="008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed" exitCode=0
Oct 30 20:36:41.654337 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.653898    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" event={"ID":"2d00166f-5e3a-416e-8b21-d5a30638c025","Type":"ContainerDied","Data":"008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed"}
Oct 30 20:36:41.654419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.654354    6015 scope.go:122] "RemoveContainer" containerID="008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed"
Oct 30 20:36:41.655315 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.655294    6015 generic.go:356] "Generic (PLEG): container finished" podID="032b436b-bd82-4e71-a709-c58ce8cbf72e" containerID="07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91" exitCode=0
Oct 30 20:36:41.655391 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.655326    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" event={"ID":"032b436b-bd82-4e71-a709-c58ce8cbf72e","Type":"ContainerDied","Data":"07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91"}
Oct 30 20:36:41.655391 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.655368    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr" event={"ID":"032b436b-bd82-4e71-a709-c58ce8cbf72e","Type":"ContainerDied","Data":"7db85af09dcb864ae5c8975db748499a694a7aa91da322520dd0ca5a44355f6c"}
Oct 30 20:36:41.655391 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.655373    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"
Oct 30 20:36:41.655391 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.655383    6015 scope.go:122] "RemoveContainer" containerID="07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91"
Oct 30 20:36:41.656080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.656045    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:36:41.656202 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.656133    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:36:41.656202 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.656182    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:36:41.657058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.656841    6015 generic.go:356] "Generic (PLEG): container finished" podID="6c4a770e-321c-4c47-93dc-2ebff03fb985" containerID="469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8" exitCode=0
Oct 30 20:36:41.657058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.656895    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"
Oct 30 20:36:41.657058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.656985    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" event={"ID":"6c4a770e-321c-4c47-93dc-2ebff03fb985","Type":"ContainerDied","Data":"469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8"}
Oct 30 20:36:41.657235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.657012    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl" event={"ID":"6c4a770e-321c-4c47-93dc-2ebff03fb985","Type":"ContainerDied","Data":"c323e970dd7d868131a7fa4bf6ef0c702c9ba00c471aeca122790d09582dc793"}
Oct 30 20:36:41.659595 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.659569    6015 generic.go:356] "Generic (PLEG): container finished" podID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerID="d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784" exitCode=0
Oct 30 20:36:41.659883 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.659863    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" event={"ID":"444d7fc5-1339-416f-b734-585f2c7ddb04","Type":"ContainerDied","Data":"d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784"}
Oct 30 20:36:41.660039 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.660016    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc" event={"ID":"444d7fc5-1339-416f-b734-585f2c7ddb04","Type":"ContainerDied","Data":"21c2d8f44a51a3f9463b71bf7ba0b92e7b7381e32ded950de159430d04ec1292"}
Oct 30 20:36:41.660039 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.659905    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"
Oct 30 20:36:41.695190 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.695101    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v" podUID="3e8dca38-1009-42b6-b5e4-e635ba755eaa" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:36:41.709963 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.709942    6015 scope.go:122] "RemoveContainer" containerID="07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91"
Oct 30 20:36:41.710338 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:41.710311    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91\": container with ID starting with 07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91 not found: ID does not exist" containerID="07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91"
Oct 30 20:36:41.710446 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.710347    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91"} err="failed to get container status \"07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91\": rpc error: code = NotFound desc = could not find container \"07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91\": container with ID starting with 07995bc5cf6c1d9c185c9391c496ad6337be794ce070891d4e747e90d6361e91 not found: ID does not exist"
Oct 30 20:36:41.710446 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.710370    6015 scope.go:122] "RemoveContainer" containerID="469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8"
Oct 30 20:36:41.723222 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.723197    6015 scope.go:122] "RemoveContainer" containerID="469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8"
Oct 30 20:36:41.723570 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:41.723548    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8\": container with ID starting with 469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8 not found: ID does not exist" containerID="469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8"
Oct 30 20:36:41.723633 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.723581    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8"} err="failed to get container status \"469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8\": rpc error: code = NotFound desc = could not find container \"469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8\": container with ID starting with 469fcc08967c00911077d18031f1bcefe941630a6c5abafdf2f0ca36d8b86df8 not found: ID does not exist"
Oct 30 20:36:41.723633 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.723597    6015 scope.go:122] "RemoveContainer" containerID="d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784"
Oct 30 20:36:41.744130 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.744090    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:41.745370 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.745348    6015 scope.go:122] "RemoveContainer" containerID="d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784"
Oct 30 20:36:41.745668 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:41.745647    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784\": container with ID starting with d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784 not found: ID does not exist" containerID="d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784"
Oct 30 20:36:41.745724 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.745676    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784"} err="failed to get container status \"d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784\": rpc error: code = NotFound desc = could not find container \"d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784\": container with ID starting with d98e9d9d47540baeb631e9422a675f16a5da74613d7345b00febdaa224671784 not found: ID does not exist"
Oct 30 20:36:41.885522 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.885415    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"]
Oct 30 20:36:41.892519 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.892475    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-w1-98a19b-kserve-8b7c44484-cmshr"]
Oct 30 20:36:41.900656 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.900614    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:41.996400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:41.996346    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"]
Oct 30 20:36:42.000226 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:42.000194    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/distinct-2-w1-98a19b-kserve-775df8bd55-g4dwl"]
Oct 30 20:36:42.104566 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:42.104528    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"]
Oct 30 20:36:42.108738 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:42.108705    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-98a19b/premium-w1-98a19b-kserve-78d4d988f7-2t8vc"]
Oct 30 20:36:42.697950 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:42.696883    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" event={"ID":"2d00166f-5e3a-416e-8b21-d5a30638c025","Type":"ContainerStarted","Data":"d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060"}
Oct 30 20:36:42.927769 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:42.927731    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:36:42.927981 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:42.927953    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused" start-of-body=
Oct 30 20:36:42.928034 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:42.928001    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused"
Oct 30 20:36:43.101740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.098946    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"]
Oct 30 20:36:43.101740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.099726    6015 cpu_manager.go:414] "containerMap: removing container" podUID="032b436b-bd82-4e71-a709-c58ce8cbf72e" containerName="main"
Oct 30 20:36:43.101740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.099748    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="032b436b-bd82-4e71-a709-c58ce8cbf72e" containerName="main"
Oct 30 20:36:43.101740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.099768    6015 cpu_manager.go:414] "containerMap: removing container" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerName="main"
Oct 30 20:36:43.101740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.099776    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerName="main"
Oct 30 20:36:43.101740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.099851    6015 cpu_manager.go:414] "containerMap: removing container" podUID="6c4a770e-321c-4c47-93dc-2ebff03fb985" containerName="main"
Oct 30 20:36:43.101740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.099860    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c4a770e-321c-4c47-93dc-2ebff03fb985" containerName="main"
Oct 30 20:36:43.101740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.100008    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c4a770e-321c-4c47-93dc-2ebff03fb985" containerName="main"
Oct 30 20:36:43.101740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.100025    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="032b436b-bd82-4e71-a709-c58ce8cbf72e" containerName="main"
Oct 30 20:36:43.101740 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.100035    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" containerName="main"
Oct 30 20:36:43.103053 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.103030    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:43.156395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.156336    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kmwqm\""
Oct 30 20:36:43.158821 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.158773    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"]
Oct 30 20:36:43.202333 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.202296    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:36:43.235942 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.235909    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-xks-ca\") pod \"maas-api-revoke-sub-72e88600-s79cx\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:43.236139 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.236115    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-72e88600-s79cx\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:43.236210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.236180    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88pz\" (UniqueName: \"kubernetes.io/projected/c8026536-8de7-4ae6-ac8e-9ac6871df721-kube-api-access-d88pz\") pod \"maas-api-revoke-sub-72e88600-s79cx\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:43.337049 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.337009    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-72e88600-s79cx\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:43.337212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.337072    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d88pz\" (UniqueName: \"kubernetes.io/projected/c8026536-8de7-4ae6-ac8e-9ac6871df721-kube-api-access-d88pz\") pod \"maas-api-revoke-sub-72e88600-s79cx\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:43.337212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.337098    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-xks-ca\") pod \"maas-api-revoke-sub-72e88600-s79cx\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:43.337644 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.337622    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-72e88600-s79cx\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:43.339597 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.339579    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-xks-ca\") pod \"maas-api-revoke-sub-72e88600-s79cx\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:43.400634 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.400546    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88pz\" (UniqueName: \"kubernetes.io/projected/c8026536-8de7-4ae6-ac8e-9ac6871df721-kube-api-access-d88pz\") pod \"maas-api-revoke-sub-72e88600-s79cx\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:43.417856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.417797    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:43.607310 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.607275    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="032b436b-bd82-4e71-a709-c58ce8cbf72e" path="/var/lib/kubelet/pods/032b436b-bd82-4e71-a709-c58ce8cbf72e/volumes"
Oct 30 20:36:43.607722 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.607708    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="444d7fc5-1339-416f-b734-585f2c7ddb04" path="/var/lib/kubelet/pods/444d7fc5-1339-416f-b734-585f2c7ddb04/volumes"
Oct 30 20:36:43.608113 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.608100    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c4a770e-321c-4c47-93dc-2ebff03fb985" path="/var/lib/kubelet/pods/6c4a770e-321c-4c47-93dc-2ebff03fb985/volumes"
Oct 30 20:36:43.835924 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.835881    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"]
Oct 30 20:36:43.841456 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:36:43.841420    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8026536_8de7_4ae6_ac8e_9ac6871df721.slice/crio-90a7b5346ac98382e62ff9957b21bc6f66a75bc52a23ce5f3b437730fb378474 WatchSource:0}: Error finding container 90a7b5346ac98382e62ff9957b21bc6f66a75bc52a23ce5f3b437730fb378474: Status 404 returned error can't find the container with id 90a7b5346ac98382e62ff9957b21bc6f66a75bc52a23ce5f3b437730fb378474
Oct 30 20:36:43.929495 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.929038    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused" start-of-body=
Oct 30 20:36:43.929495 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:43.929114    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused"
Oct 30 20:36:44.140852 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:44.140793    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:44.711836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:44.711777    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx" event={"ID":"c8026536-8de7-4ae6-ac8e-9ac6871df721","Type":"ContainerStarted","Data":"0047ee7b79456ae3fb47d35a9426d1fd237ba64c9925880b190e2b07b5f28ade"}
Oct 30 20:36:44.712037 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:44.711868    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx" event={"ID":"c8026536-8de7-4ae6-ac8e-9ac6871df721","Type":"ContainerStarted","Data":"90a7b5346ac98382e62ff9957b21bc6f66a75bc52a23ce5f3b437730fb378474"}
Oct 30 20:36:44.823890 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:44.823835    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx" podStartSLOduration=1.8237980999999999 podStartE2EDuration="1.8237981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:44.82174594 +0000 UTC m=+4267.364553209" watchObservedRunningTime="2026-10-30 20:36:44.8237981 +0000 UTC m=+4267.366605361"
Oct 30 20:36:44.861909 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:44.861860    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:44.928223 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:44.928184    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused" start-of-body=
Oct 30 20:36:44.928408 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:44.928248    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused"
Oct 30 20:36:45.036582 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.036552    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:45.290490 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.289908    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"]
Oct 30 20:36:45.293390 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.293363    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:36:45.332134 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.332093    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"]
Oct 30 20:36:45.343528 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.343485    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-b-273c1b\""
Oct 30 20:36:45.343843 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.343791    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-b-273c1b-dockercfg-gndq5\""
Oct 30 20:36:45.362630 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.362584    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71d80089-5efc-425c-991c-31cf7f7854e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2\" (UID: \"71d80089-5efc-425c-991c-31cf7f7854e8\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:36:45.362865 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.362838    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnkh6\" (UniqueName: \"kubernetes.io/projected/71d80089-5efc-425c-991c-31cf7f7854e8-kube-api-access-vnkh6\") pod \"payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2\" (UID: \"71d80089-5efc-425c-991c-31cf7f7854e8\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:36:45.417173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.417132    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"]
Oct 30 20:36:45.428170 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.428133    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:36:45.464118 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.464080    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnkh6\" (UniqueName: \"kubernetes.io/projected/71d80089-5efc-425c-991c-31cf7f7854e8-kube-api-access-vnkh6\") pod \"payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2\" (UID: \"71d80089-5efc-425c-991c-31cf7f7854e8\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:36:45.464337 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.464248    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71d80089-5efc-425c-991c-31cf7f7854e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2\" (UID: \"71d80089-5efc-425c-991c-31cf7f7854e8\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:36:45.469833 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.465080    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71d80089-5efc-425c-991c-31cf7f7854e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2\" (UID: \"71d80089-5efc-425c-991c-31cf7f7854e8\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:36:45.494832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.494467    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"]
Oct 30 20:36:45.524262 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.524219    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnkh6\" (UniqueName: \"kubernetes.io/projected/71d80089-5efc-425c-991c-31cf7f7854e8-kube-api-access-vnkh6\") pod \"payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2\" (UID: \"71d80089-5efc-425c-991c-31cf7f7854e8\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:36:45.589831 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.589639    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z42vs\" (UniqueName: \"kubernetes.io/projected/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-kube-api-access-z42vs\") pod \"payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr\" (UID: \"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:36:45.590076 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.589929    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr\" (UID: \"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:36:45.606675 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.606638    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:36:45.693834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.693627    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z42vs\" (UniqueName: \"kubernetes.io/projected/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-kube-api-access-z42vs\") pod \"payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr\" (UID: \"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:36:45.693834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.693698    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr\" (UID: \"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:36:45.695481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.695317    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr\" (UID: \"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:36:45.722707 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.722675    6015 generic.go:356] "Generic (PLEG): container finished" podID="c8026536-8de7-4ae6-ac8e-9ac6871df721" containerID="0047ee7b79456ae3fb47d35a9426d1fd237ba64c9925880b190e2b07b5f28ade" exitCode=0
Oct 30 20:36:45.722906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.722753    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx" event={"ID":"c8026536-8de7-4ae6-ac8e-9ac6871df721","Type":"ContainerDied","Data":"0047ee7b79456ae3fb47d35a9426d1fd237ba64c9925880b190e2b07b5f28ade"}
Oct 30 20:36:45.753007 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.752969    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z42vs\" (UniqueName: \"kubernetes.io/projected/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-kube-api-access-z42vs\") pod \"payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr\" (UID: \"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:36:45.928006 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.927921    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused" start-of-body=
Oct 30 20:36:45.928006 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.927974    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused"
Oct 30 20:36:45.992661 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:45.992617    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"]
Oct 30 20:36:45.998953 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:36:45.998924    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d80089_5efc_425c_991c_31cf7f7854e8.slice/crio-8090a7a9df57dd564194c59739e0546098af3423d4e7330918782258ea8374be WatchSource:0}: Error finding container 8090a7a9df57dd564194c59739e0546098af3423d4e7330918782258ea8374be: Status 404 returned error can't find the container with id 8090a7a9df57dd564194c59739e0546098af3423d4e7330918782258ea8374be
Oct 30 20:36:46.048872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.048841    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:36:46.451306 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.451269    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"]
Oct 30 20:36:46.457267 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:36:46.457229    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7f2e65_2c06_478b_a0a2_ac63e9fc11ad.slice/crio-672d9bb02dc4a06faff1fa18e231ae1e704f135d7a5c0010d2e986c0364b29db WatchSource:0}: Error finding container 672d9bb02dc4a06faff1fa18e231ae1e704f135d7a5c0010d2e986c0364b29db: Status 404 returned error can't find the container with id 672d9bb02dc4a06faff1fa18e231ae1e704f135d7a5c0010d2e986c0364b29db
Oct 30 20:36:46.730965 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.730860    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr" event={"ID":"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad","Type":"ContainerStarted","Data":"0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5"}
Oct 30 20:36:46.730965 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.730926    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr" event={"ID":"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad","Type":"ContainerStarted","Data":"672d9bb02dc4a06faff1fa18e231ae1e704f135d7a5c0010d2e986c0364b29db"}
Oct 30 20:36:46.731160 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.731062    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:36:46.732649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.732623    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2" event={"ID":"71d80089-5efc-425c-991c-31cf7f7854e8","Type":"ContainerStarted","Data":"095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b"}
Oct 30 20:36:46.732834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.732683    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2" event={"ID":"71d80089-5efc-425c-991c-31cf7f7854e8","Type":"ContainerStarted","Data":"8090a7a9df57dd564194c59739e0546098af3423d4e7330918782258ea8374be"}
Oct 30 20:36:46.732834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.732800    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:36:46.848967 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.848675    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr" podStartSLOduration=1.8486557019999998 podStartE2EDuration="1.848655702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:46.848201592 +0000 UTC m=+4269.391008858" watchObservedRunningTime="2026-10-30 20:36:46.848655702 +0000 UTC m=+4269.391462967"
Oct 30 20:36:46.927764 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.927730    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused" start-of-body=
Oct 30 20:36:46.927982 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.927792    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused"
Oct 30 20:36:46.929793 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.929768    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:46.962392 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:46.962328    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2" podStartSLOduration=1.962313193 podStartE2EDuration="1.962313193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:46.959133952 +0000 UTC m=+4269.501941217" watchObservedRunningTime="2026-10-30 20:36:46.962313193 +0000 UTC m=+4269.505120457"
Oct 30 20:36:47.008265 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.008171    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8026536-8de7-4ae6-ac8e-9ac6871df721-kube-api-access-d88pz\" (UniqueName: \"kubernetes.io/projected/c8026536-8de7-4ae6-ac8e-9ac6871df721-kube-api-access-d88pz\") pod \"c8026536-8de7-4ae6-ac8e-9ac6871df721\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") "
Oct 30 20:36:47.008450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.008294    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-xks-ca\") pod \"c8026536-8de7-4ae6-ac8e-9ac6871df721\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") "
Oct 30 20:36:47.008450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.008355    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-openshift-ca\") pod \"c8026536-8de7-4ae6-ac8e-9ac6871df721\" (UID: \"c8026536-8de7-4ae6-ac8e-9ac6871df721\") "
Oct 30 20:36:47.008725 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.008701    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-openshift-ca" pod "c8026536-8de7-4ae6-ac8e-9ac6871df721" (UID: "c8026536-8de7-4ae6-ac8e-9ac6871df721"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:36:47.010645 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.010616    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8026536-8de7-4ae6-ac8e-9ac6871df721-kube-api-access-d88pz" pod "c8026536-8de7-4ae6-ac8e-9ac6871df721" (UID: "c8026536-8de7-4ae6-ac8e-9ac6871df721"). InnerVolumeSpecName "kube-api-access-d88pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:36:47.010749 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.010650    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-xks-ca" pod "c8026536-8de7-4ae6-ac8e-9ac6871df721" (UID: "c8026536-8de7-4ae6-ac8e-9ac6871df721"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:36:47.109984 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.109932    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-xks-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:47.109984 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.109977    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8026536-8de7-4ae6-ac8e-9ac6871df721-maas-api-openshift-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:47.109984 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.109993    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d88pz\" (UniqueName: \"kubernetes.io/projected/c8026536-8de7-4ae6-ac8e-9ac6871df721-kube-api-access-d88pz\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:36:47.741416 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.741383    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"
Oct 30 20:36:47.741942 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.741922    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx" event={"ID":"c8026536-8de7-4ae6-ac8e-9ac6871df721","Type":"ContainerDied","Data":"90a7b5346ac98382e62ff9957b21bc6f66a75bc52a23ce5f3b437730fb378474"}
Oct 30 20:36:47.742007 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.741968    6015 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90a7b5346ac98382e62ff9957b21bc6f66a75bc52a23ce5f3b437730fb378474"
Oct 30 20:36:47.928431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.928329    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused" start-of-body=
Oct 30 20:36:47.928431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:47.928397    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.169:15021/healthz/ready\": dial tcp 10.134.0.169:15021: connect: connection refused"
Oct 30 20:36:48.846661 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:48.846474    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:48.932819 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:48.932774    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:36:48.933203 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:48.933181    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:36:48.934059 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:48.934037    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:36:49.032190 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:49.032138    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:50.510252 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:50.510206    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:50.782272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:50.782168    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:50.941286 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:50.941245    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:51.090697 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:51.090657    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:51.399250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:51.399162    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:51.695757 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:51.695660    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v" podUID="3e8dca38-1009-42b6-b5e4-e635ba755eaa" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:36:54.117908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:54.117869    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:54.390148 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:54.390057    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:56.280862 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:56.280783    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:57.197830 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:57.197758    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:57.352335 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:57.352277    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:57.704729 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:57.704653    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:57.745079 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:57.745048    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:36:57.745272 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:57.745118    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:36:57.877289 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:57.877249    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:58.119447 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:36:58.119413    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:58.220499 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:36:58.220460    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:37:00.478904 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.478878    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 20:37:00.567968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.567929    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e8dca38-1009-42b6-b5e4-e635ba755eaa-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8dca38-1009-42b6-b5e4-e635ba755eaa-plugins-config-volume\") pod \"3e8dca38-1009-42b6-b5e4-e635ba755eaa\" (UID: \"3e8dca38-1009-42b6-b5e4-e635ba755eaa\") "
Oct 30 20:37:00.568153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.567986    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e8dca38-1009-42b6-b5e4-e635ba755eaa-kube-api-access-dtqrx\" (UniqueName: \"kubernetes.io/projected/3e8dca38-1009-42b6-b5e4-e635ba755eaa-kube-api-access-dtqrx\") pod \"3e8dca38-1009-42b6-b5e4-e635ba755eaa\" (UID: \"3e8dca38-1009-42b6-b5e4-e635ba755eaa\") "
Oct 30 20:37:00.568360 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.568336    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e8dca38-1009-42b6-b5e4-e635ba755eaa-plugins-config-volume" pod "3e8dca38-1009-42b6-b5e4-e635ba755eaa" (UID: "3e8dca38-1009-42b6-b5e4-e635ba755eaa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:37:00.570361 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.570337    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e8dca38-1009-42b6-b5e4-e635ba755eaa-kube-api-access-dtqrx" pod "3e8dca38-1009-42b6-b5e4-e635ba755eaa" (UID: "3e8dca38-1009-42b6-b5e4-e635ba755eaa"). InnerVolumeSpecName "kube-api-access-dtqrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:37:00.670112 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.670073    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e8dca38-1009-42b6-b5e4-e635ba755eaa-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:00.670112 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.670109    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtqrx\" (UniqueName: \"kubernetes.io/projected/3e8dca38-1009-42b6-b5e4-e635ba755eaa-kube-api-access-dtqrx\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:00.834866 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.834801    6015 generic.go:356] "Generic (PLEG): container finished" podID="3e8dca38-1009-42b6-b5e4-e635ba755eaa" containerID="5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006" exitCode=0
Oct 30 20:37:00.835056 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.834885    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"
Oct 30 20:37:00.835056 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.834918    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v" event={"ID":"3e8dca38-1009-42b6-b5e4-e635ba755eaa","Type":"ContainerDied","Data":"5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006"}
Oct 30 20:37:00.835056 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.834976    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v" event={"ID":"3e8dca38-1009-42b6-b5e4-e635ba755eaa","Type":"ContainerDied","Data":"52cb26d250d231d999cf8ca0c1f1905222f9c7f7baf2225ea7d85beefdf49050"}
Oct 30 20:37:00.835056 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.834998    6015 scope.go:122] "RemoveContainer" containerID="5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006"
Oct 30 20:37:00.845080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.845052    6015 scope.go:122] "RemoveContainer" containerID="5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006"
Oct 30 20:37:00.845406 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:37:00.845384    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006\": container with ID starting with 5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006 not found: ID does not exist" containerID="5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006"
Oct 30 20:37:00.845481 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.845416    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006"} err="failed to get container status \"5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006\": rpc error: code = NotFound desc = could not find container \"5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006\": container with ID starting with 5b9401d37bb656df7a0fcc58d29542a9f425192e261574c46b3a462d8b8d0006 not found: ID does not exist"
Oct 30 20:37:00.999474 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:00.999436    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"]
Oct 30 20:37:01.046559 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:01.046522    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-98a19b-658f7749b7-gxt8v"]
Oct 30 20:37:01.585428 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:01.585390    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e8dca38-1009-42b6-b5e4-e635ba755eaa" path="/var/lib/kubelet/pods/3e8dca38-1009-42b6-b5e4-e635ba755eaa/volumes"
Oct 30 20:37:01.956576 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:01.956483    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:02.755891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:02.754760    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:02.908058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:02.908020    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:03.433506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:03.433469    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:04.525549 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:04.525512    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:07.240728 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:07.240690    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:10.917778 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:10.917740    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:11.113027 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:11.112986    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:12.418382 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:12.418345    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:17.509457 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:17.509420    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:22.494631 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:22.494591    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:27.504993 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:27.504947    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:27.673455 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:27.673406    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:27.935212 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:27.935176    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:28.215600 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:37:28.215515    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:37:32.149588 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:32.149553    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:33.810136 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:33.810099    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:34.005243 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:34.005208    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:34.159210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:34.159115    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:34.730944 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:34.730904    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:35.930313 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:35.930271    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:36.082440 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:36.082404    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:38.804225 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:38.804185    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"]
Oct 30 20:37:38.804780 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:38.804417    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj" podUID="e3ba1452-be29-49f4-923f-a535693624fe" containerName="maas-api" containerID="cri-o://b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea" gracePeriod=30
Oct 30 20:37:38.918276 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:38.918230    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:39.079902 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.079874    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 20:37:39.087216 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.087175    6015 generic.go:356] "Generic (PLEG): container finished" podID="e3ba1452-be29-49f4-923f-a535693624fe" containerID="b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea" exitCode=0
Oct 30 20:37:39.087398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.087222    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj" event={"ID":"e3ba1452-be29-49f4-923f-a535693624fe","Type":"ContainerDied","Data":"b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea"}
Oct 30 20:37:39.087398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.087227    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"
Oct 30 20:37:39.087398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.087262    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj" event={"ID":"e3ba1452-be29-49f4-923f-a535693624fe","Type":"ContainerDied","Data":"eb5e72951a13bed0ff37f0415dff3da1046ec6caac3af37d50dbd90b40466892"}
Oct 30 20:37:39.087398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.087283    6015 scope.go:122] "RemoveContainer" containerID="b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea"
Oct 30 20:37:39.099160 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.099133    6015 scope.go:122] "RemoveContainer" containerID="b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea"
Oct 30 20:37:39.099538 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:37:39.099514    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea\": container with ID starting with b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea not found: ID does not exist" containerID="b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea"
Oct 30 20:37:39.099668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.099549    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea"} err="failed to get container status \"b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea\": rpc error: code = NotFound desc = could not find container \"b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea\": container with ID starting with b10522168d90aa8801991617044ed90e0641a0f0aae7bf92b3b1213dd0f2dfea not found: ID does not exist"
Oct 30 20:37:39.245923 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.245897    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-maas-api-tls\") pod \"e3ba1452-be29-49f4-923f-a535693624fe\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") "
Oct 30 20:37:39.245998 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.245936    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e3ba1452-be29-49f4-923f-a535693624fe-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ba1452-be29-49f4-923f-a535693624fe-openshift-service-ca\") pod \"e3ba1452-be29-49f4-923f-a535693624fe\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") "
Oct 30 20:37:39.245998 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.245990    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-metrics-certs\") pod \"e3ba1452-be29-49f4-923f-a535693624fe\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") "
Oct 30 20:37:39.246202 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.246183    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e3ba1452-be29-49f4-923f-a535693624fe-kube-api-access-sx2lr\" (UniqueName: \"kubernetes.io/projected/e3ba1452-be29-49f4-923f-a535693624fe-kube-api-access-sx2lr\") pod \"e3ba1452-be29-49f4-923f-a535693624fe\" (UID: \"e3ba1452-be29-49f4-923f-a535693624fe\") "
Oct 30 20:37:39.246363 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.246343    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ba1452-be29-49f4-923f-a535693624fe-openshift-service-ca" pod "e3ba1452-be29-49f4-923f-a535693624fe" (UID: "e3ba1452-be29-49f4-923f-a535693624fe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:37:39.246583 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.246566    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ba1452-be29-49f4-923f-a535693624fe-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:39.248411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.248384    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-metrics-certs" pod "e3ba1452-be29-49f4-923f-a535693624fe" (UID: "e3ba1452-be29-49f4-923f-a535693624fe"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:37:39.248562 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.248539    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-maas-api-tls" pod "e3ba1452-be29-49f4-923f-a535693624fe" (UID: "e3ba1452-be29-49f4-923f-a535693624fe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:37:39.248617 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.248587    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ba1452-be29-49f4-923f-a535693624fe-kube-api-access-sx2lr" pod "e3ba1452-be29-49f4-923f-a535693624fe" (UID: "e3ba1452-be29-49f4-923f-a535693624fe"). InnerVolumeSpecName "kube-api-access-sx2lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:37:39.347952 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.347860    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx2lr\" (UniqueName: \"kubernetes.io/projected/e3ba1452-be29-49f4-923f-a535693624fe-kube-api-access-sx2lr\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:39.347952 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.347892    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:39.347952 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.347903    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3ba1452-be29-49f4-923f-a535693624fe-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:39.503615 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.503255    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"]
Oct 30 20:37:39.506597 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.506552    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-bbfa07-5b668dcfdf-qmctj"]
Oct 30 20:37:39.587681 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:39.587648    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e3ba1452-be29-49f4-923f-a535693624fe" path="/var/lib/kubelet/pods/e3ba1452-be29-49f4-923f-a535693624fe/volumes"
Oct 30 20:37:40.570574 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:40.570538    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:40.815632 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:40.815597    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:40.973336 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:40.973234    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:41.169430 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:41.169396    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:41.322620 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:41.322580    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:41.508593 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:41.508557    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:41.683332 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:41.683230    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:46.368957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:46.368857    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:48.347733 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:48.347691    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:48.547161 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:48.547121    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:48.674569 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:48.674465    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"]
Oct 30 20:37:48.674762 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:48.674724    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" podUID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" containerName="istio-proxy" containerID="cri-o://0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d" gracePeriod=30
Oct 30 20:37:48.701000 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:48.700956    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:51.241878 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:51.241840    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:52.461061 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:52.461026    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:52.847570 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:52.847528    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:53.134311 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:53.134220    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:53.538128 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:53.538042    6015 patch_prober.go:29] interesting pod/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:37:53.538128 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:53.538111    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" podUID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:37:53.793611 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:53.793574    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:54.023572 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.023545    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 20:37:54.115330 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.115291    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:54.122287 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122252    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istiod-ca-cert\") pod \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") "
Oct 30 20:37:54.122462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122298    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-kube-api-access-dl49j\" (UniqueName: \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-kube-api-access-dl49j\") pod \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") "
Oct 30 20:37:54.122462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122331    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-data\") pod \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") "
Oct 30 20:37:54.122462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122371    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-socket\") pod \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") "
Oct 30 20:37:54.122462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122416    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-podinfo\") pod \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") "
Oct 30 20:37:54.122717 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122465    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-token\" (UniqueName: \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-token\") pod \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") "
Oct 30 20:37:54.122717 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122650    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-certs\") pod \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") "
Oct 30 20:37:54.122717 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122683    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-data" pod "d1ceebb6-a0c0-4b43-8261-6bb6144d754b" (UID: "d1ceebb6-a0c0-4b43-8261-6bb6144d754b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:37:54.122717 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122702    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-credential-socket\") pod \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") "
Oct 30 20:37:54.122968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122834    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istiod-ca-cert" pod "d1ceebb6-a0c0-4b43-8261-6bb6144d754b" (UID: "d1ceebb6-a0c0-4b43-8261-6bb6144d754b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:37:54.122968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122855    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-socket" pod "d1ceebb6-a0c0-4b43-8261-6bb6144d754b" (UID: "d1ceebb6-a0c0-4b43-8261-6bb6144d754b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:37:54.122968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122862    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-envoy\") pod \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\" (UID: \"d1ceebb6-a0c0-4b43-8261-6bb6144d754b\") "
Oct 30 20:37:54.122968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122882    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-certs" pod "d1ceebb6-a0c0-4b43-8261-6bb6144d754b" (UID: "d1ceebb6-a0c0-4b43-8261-6bb6144d754b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:37:54.122968 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.122959    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-credential-socket" pod "d1ceebb6-a0c0-4b43-8261-6bb6144d754b" (UID: "d1ceebb6-a0c0-4b43-8261-6bb6144d754b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:37:54.123462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.123361    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:54.123567 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.123551    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:54.123646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.123571    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:54.123646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.123585    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:54.123646 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.123602    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:54.125027 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.124997    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-podinfo" pod "d1ceebb6-a0c0-4b43-8261-6bb6144d754b" (UID: "d1ceebb6-a0c0-4b43-8261-6bb6144d754b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:37:54.125027 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.125016    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-envoy" pod "d1ceebb6-a0c0-4b43-8261-6bb6144d754b" (UID: "d1ceebb6-a0c0-4b43-8261-6bb6144d754b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:37:54.125423 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.125398    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-kube-api-access-dl49j" pod "d1ceebb6-a0c0-4b43-8261-6bb6144d754b" (UID: "d1ceebb6-a0c0-4b43-8261-6bb6144d754b"). InnerVolumeSpecName "kube-api-access-dl49j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:37:54.125530 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.125452    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-token" pod "d1ceebb6-a0c0-4b43-8261-6bb6144d754b" (UID: "d1ceebb6-a0c0-4b43-8261-6bb6144d754b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:37:54.207289 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.207252    6015 generic.go:356] "Generic (PLEG): container finished" podID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" containerID="0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d" exitCode=0
Oct 30 20:37:54.207470 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.207349    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"
Oct 30 20:37:54.207470 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.207381    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" event={"ID":"d1ceebb6-a0c0-4b43-8261-6bb6144d754b","Type":"ContainerDied","Data":"0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d"}
Oct 30 20:37:54.207470 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.207461    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl" event={"ID":"d1ceebb6-a0c0-4b43-8261-6bb6144d754b","Type":"ContainerDied","Data":"e1e7af0946f30ad554dfdcf13cb92e4ffb41bf5b5609a6cbbfa96f56079ad1f7"}
Oct 30 20:37:54.207695 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.207485    6015 scope.go:122] "RemoveContainer" containerID="0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d"
Oct 30 20:37:54.220915 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.220893    6015 scope.go:122] "RemoveContainer" containerID="0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d"
Oct 30 20:37:54.221316 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:37:54.221293    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d\": container with ID starting with 0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d not found: ID does not exist" containerID="0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d"
Oct 30 20:37:54.221425 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.221325    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d"} err="failed to get container status \"0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d\": rpc error: code = NotFound desc = could not find container \"0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d\": container with ID starting with 0dca8a1df111053562fbe1eb4c3b1eba563c848ce2ce7adaf5cea6eb47df113d not found: ID does not exist"
Oct 30 20:37:54.225244 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.225216    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:54.225345 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.225250    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:54.225345 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.225266    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl49j\" (UniqueName: \"kubernetes.io/projected/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-kube-api-access-dl49j\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:54.225345 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.225282    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ceebb6-a0c0-4b43-8261-6bb6144d754b-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:37:54.390080 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.389977    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"]
Oct 30 20:37:54.391612 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.391584    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-bbfa07-openshift-default-77bf654b75-mpwfl"]
Oct 30 20:37:54.407966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.407936    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:54.559501 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:54.559458    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:55.091376 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:55.091327    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:37:55.595835 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:55.595740    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" path="/var/lib/kubelet/pods/d1ceebb6-a0c0-4b43-8261-6bb6144d754b/volumes"
Oct 30 20:37:58.226325 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:37:58.226288    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:37:59.793298 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:37:59.793256    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:00.140293 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:00.140201    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:00.297248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:00.297210    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:00.463499 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:00.463403    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:01.743295 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:01.743261    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:01.919881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:01.919794    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:02.147068 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:02.145710    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:03.266493 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:03.266460    6015 generic.go:356] "Generic (PLEG): container finished" podID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerID="9c1d8f36988fa93a42cf9a510445ec08422f17a9da79ef0a4a64b3632c8b0151" exitCode=0
Oct 30 20:38:03.266918 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:03.266528    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" event={"ID":"696e031c-3499-48ce-a9dd-dc02da84d95e","Type":"ContainerDied","Data":"9c1d8f36988fa93a42cf9a510445ec08422f17a9da79ef0a4a64b3632c8b0151"}
Oct 30 20:38:03.266964 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:03.266954    6015 scope.go:122] "RemoveContainer" containerID="9c1d8f36988fa93a42cf9a510445ec08422f17a9da79ef0a4a64b3632c8b0151"
Oct 30 20:38:03.268344 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:03.268317    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:03.268404 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:03.268390    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:03.268444 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:03.268425    6015 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:38:03.792126 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:03.792079    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:04.297378 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:04.297337    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" event={"ID":"696e031c-3499-48ce-a9dd-dc02da84d95e","Type":"ContainerStarted","Data":"069fc408baeb1426afad65aec4a6a8d73434dd940c5ee8acc1bfaca8edd690c7"}
Oct 30 20:38:05.035320 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:05.035278    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:38:05.036591 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:05.036557    6015 patch_prober.go:29] interesting pod/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.174:15021/healthz/ready\": dial tcp 10.134.0.174:15021: connect: connection refused" start-of-body=
Oct 30 20:38:05.036744 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:05.036624    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.174:15021/healthz/ready\": dial tcp 10.134.0.174:15021: connect: connection refused"
Oct 30 20:38:05.405228 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:05.405190    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:06.034918 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:06.034872    6015 patch_prober.go:29] interesting pod/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.174:15021/healthz/ready\": dial tcp 10.134.0.174:15021: connect: connection refused" start-of-body=
Oct 30 20:38:06.035164 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:06.034941    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.174:15021/healthz/ready\": dial tcp 10.134.0.174:15021: connect: connection refused"
Oct 30 20:38:07.035551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:07.035509    6015 patch_prober.go:29] interesting pod/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.174:15021/healthz/ready\": dial tcp 10.134.0.174:15021: connect: connection refused" start-of-body=
Oct 30 20:38:07.036005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:07.035565    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.174:15021/healthz/ready\": dial tcp 10.134.0.174:15021: connect: connection refused"
Oct 30 20:38:08.034666 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:08.034631    6015 patch_prober.go:29] interesting pod/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.174:15021/healthz/ready\": dial tcp 10.134.0.174:15021: connect: connection refused" start-of-body=
Oct 30 20:38:08.034920 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:08.034894    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.174:15021/healthz/ready\": dial tcp 10.134.0.174:15021: connect: connection refused"
Oct 30 20:38:09.035371 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:09.035328    6015 patch_prober.go:29] interesting pod/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.174:15021/healthz/ready\": dial tcp 10.134.0.174:15021: connect: connection refused" start-of-body=
Oct 30 20:38:09.035790 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:09.035390    6015 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.174:15021/healthz/ready\": dial tcp 10.134.0.174:15021: connect: connection refused"
Oct 30 20:38:09.641406 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:09.641368    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:38:10.039520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:10.039434    6015 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:38:10.334467 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:10.334433    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:38:10.594260 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:10.594142    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:14.645891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:14.645846    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"]
Oct 30 20:38:15.042973 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:15.042944    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:15.255485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:15.255447    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:15.696725 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:15.696685    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:19.646916 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:19.646800    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8" podUID="f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb" containerName="payload-processing" containerID="cri-o://b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130" gracePeriod=25
Oct 30 20:38:20.837478 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:20.837432    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8" podUID="f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:38:20.915625 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:20.915587    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:23.457737 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:23.457699    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:24.588454 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:24.588410    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:24.755753 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:24.755716    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:24.920437 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:24.920345    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:25.210962 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:25.210861    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:25.370586 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:25.370554    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:26.230254 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:26.230205    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:26.381427 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:26.381395    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:26.544142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:26.544104    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:28.215340 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:38:28.215289    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:38:30.451758 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:30.451716    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:30.838410 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:30.838367    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8" podUID="f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:38:31.508576 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:31.508533    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:36.596837 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:36.596778    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:39.921200 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:39.921132    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:38:40.000664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.000623    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-kube-api-access-rj28v\" (UniqueName: \"kubernetes.io/projected/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-kube-api-access-rj28v\") pod \"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb\" (UID: \"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb\") "
Oct 30 20:38:40.000664 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.000668    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-plugins-config-volume\") pod \"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb\" (UID: \"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb\") "
Oct 30 20:38:40.001096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.001074    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-plugins-config-volume" pod "f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb" (UID: "f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:40.003040 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.003018    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-kube-api-access-rj28v" pod "f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb" (UID: "f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb"). InnerVolumeSpecName "kube-api-access-rj28v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:38:40.102122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.102069    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj28v\" (UniqueName: \"kubernetes.io/projected/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-kube-api-access-rj28v\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:38:40.102122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.102105    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:38:40.526454 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.526421    6015 generic.go:356] "Generic (PLEG): container finished" podID="f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb" containerID="b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130" exitCode=0
Oct 30 20:38:40.526668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.526472    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"
Oct 30 20:38:40.526668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.526504    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8" event={"ID":"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb","Type":"ContainerDied","Data":"b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130"}
Oct 30 20:38:40.526668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.526574    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8" event={"ID":"f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb","Type":"ContainerDied","Data":"4c8a484f0377138d54d5dd8408e2c790c7ea7797ede37965d73ce98e2892e786"}
Oct 30 20:38:40.526668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.526602    6015 scope.go:122] "RemoveContainer" containerID="b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130"
Oct 30 20:38:40.538945 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.538917    6015 scope.go:122] "RemoveContainer" containerID="b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130"
Oct 30 20:38:40.539277 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:38:40.539253    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130\": container with ID starting with b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130 not found: ID does not exist" containerID="b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130"
Oct 30 20:38:40.539360 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.539291    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130"} err="failed to get container status \"b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130\": rpc error: code = NotFound desc = could not find container \"b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130\": container with ID starting with b87d08ccd036148991e2e68d300ff2e88740eb09116773a3c54b66900132b130 not found: ID does not exist"
Oct 30 20:38:40.685999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.685967    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"]
Oct 30 20:38:40.734268 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:40.734225    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-e4864d-847fd98bb4-gpcm8"]
Oct 30 20:38:41.586156 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:41.586124    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb" path="/var/lib/kubelet/pods/f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb/volumes"
Oct 30 20:38:41.707265 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:41.707234    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:46.808472 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:46.808428    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:51.264690 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:51.264652    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:52.859550 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:52.859506    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:53.122453 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:53.122372    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:53.289454 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:53.289411    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:53.830795 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:53.830760    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:58.215417 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:38:58.215380    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:38:58.521523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:38:58.521434    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:00.247133 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:00.247097    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:00.416340 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:00.416297    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:00.598259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:00.598204    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"]
Oct 30 20:39:00.598489 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:00.598464    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy" containerID="cri-o://60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed" gracePeriod=30
Oct 30 20:39:00.601943 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:00.601914    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:01.063850 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:01.063788    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:01.828498 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:01.828450    6015 patch_prober.go:29] interesting pod/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:39:01.829015 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:01.828525    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:39:04.057482 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:04.057431    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:04.255777 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:04.255739    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:05.857014 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.856986    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:39:05.994574 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.994496    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/88448a71-1695-4c8e-9eea-7acf648d9f0f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88448a71-1695-4c8e-9eea-7acf648d9f0f-istiod-ca-cert\") pod \"88448a71-1695-4c8e-9eea-7acf648d9f0f\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") "
Oct 30 20:39:05.994574 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.994541    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-data\") pod \"88448a71-1695-4c8e-9eea-7acf648d9f0f\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") "
Oct 30 20:39:05.994574 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.994566    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-socket\") pod \"88448a71-1695-4c8e-9eea-7acf648d9f0f\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") "
Oct 30 20:39:05.994875 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.994586    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-kube-api-access-57xkz\" (UniqueName: \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-kube-api-access-57xkz\") pod \"88448a71-1695-4c8e-9eea-7acf648d9f0f\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") "
Oct 30 20:39:05.994875 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.994617    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-token\" (UniqueName: \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-token\") pod \"88448a71-1695-4c8e-9eea-7acf648d9f0f\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") "
Oct 30 20:39:05.994875 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.994641    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-certs\") pod \"88448a71-1695-4c8e-9eea-7acf648d9f0f\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") "
Oct 30 20:39:05.994875 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.994772    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-credential-socket\") pod \"88448a71-1695-4c8e-9eea-7acf648d9f0f\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") "
Oct 30 20:39:05.995092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.994901    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-podinfo\") pod \"88448a71-1695-4c8e-9eea-7acf648d9f0f\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") "
Oct 30 20:39:05.995092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.994983    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-socket" pod "88448a71-1695-4c8e-9eea-7acf648d9f0f" (UID: "88448a71-1695-4c8e-9eea-7acf648d9f0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:05.995213 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.995128    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-certs" pod "88448a71-1695-4c8e-9eea-7acf648d9f0f" (UID: "88448a71-1695-4c8e-9eea-7acf648d9f0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:05.995213 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.995146    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-credential-socket" pod "88448a71-1695-4c8e-9eea-7acf648d9f0f" (UID: "88448a71-1695-4c8e-9eea-7acf648d9f0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:05.995342 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.995208    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-data" pod "88448a71-1695-4c8e-9eea-7acf648d9f0f" (UID: "88448a71-1695-4c8e-9eea-7acf648d9f0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:05.995342 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.995327    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-envoy\") pod \"88448a71-1695-4c8e-9eea-7acf648d9f0f\" (UID: \"88448a71-1695-4c8e-9eea-7acf648d9f0f\") "
Oct 30 20:39:05.995467 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.995392    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88448a71-1695-4c8e-9eea-7acf648d9f0f-istiod-ca-cert" pod "88448a71-1695-4c8e-9eea-7acf648d9f0f" (UID: "88448a71-1695-4c8e-9eea-7acf648d9f0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:05.995856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.995742    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88448a71-1695-4c8e-9eea-7acf648d9f0f-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:05.995856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.995769    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:05.995856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.995784    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:05.995856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.995797    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:05.995856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.995831    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:05.997373 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.997343    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-podinfo" pod "88448a71-1695-4c8e-9eea-7acf648d9f0f" (UID: "88448a71-1695-4c8e-9eea-7acf648d9f0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:39:05.997656 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.997626    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-token" pod "88448a71-1695-4c8e-9eea-7acf648d9f0f" (UID: "88448a71-1695-4c8e-9eea-7acf648d9f0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:05.998060 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.998034    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-envoy" pod "88448a71-1695-4c8e-9eea-7acf648d9f0f" (UID: "88448a71-1695-4c8e-9eea-7acf648d9f0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:05.998578 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:05.998557    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-kube-api-access-57xkz" pod "88448a71-1695-4c8e-9eea-7acf648d9f0f" (UID: "88448a71-1695-4c8e-9eea-7acf648d9f0f"). InnerVolumeSpecName "kube-api-access-57xkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:06.031400 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.031362    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"]
Oct 30 20:39:06.097180 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.097141    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57xkz\" (UniqueName: \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-kube-api-access-57xkz\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:06.097180 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.097177    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:06.097180 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.097189    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:06.097440 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.097199    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88448a71-1695-4c8e-9eea-7acf648d9f0f-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:06.146002 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.145965    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:06.352905 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.352864    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:06.513946 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.513906    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:06.689658 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.689563    6015 generic.go:356] "Generic (PLEG): container finished" podID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerID="60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed" exitCode=0
Oct 30 20:39:06.689658 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.689612    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"
Oct 30 20:39:06.689957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.689652    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" event={"ID":"88448a71-1695-4c8e-9eea-7acf648d9f0f","Type":"ContainerDied","Data":"60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed"}
Oct 30 20:39:06.689957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.689720    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr" event={"ID":"88448a71-1695-4c8e-9eea-7acf648d9f0f","Type":"ContainerDied","Data":"320c81b3850be6036a52a6904d4d3d977a141f1e997b42134d167ffdad36c305"}
Oct 30 20:39:06.689957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.689747    6015 scope.go:122] "RemoveContainer" containerID="60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed"
Oct 30 20:39:06.700426 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.700406    6015 scope.go:122] "RemoveContainer" containerID="e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02"
Oct 30 20:39:06.711018 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.710992    6015 scope.go:122] "RemoveContainer" containerID="60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed"
Oct 30 20:39:06.711384 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:39:06.711346    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed\": container with ID starting with 60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed not found: ID does not exist" containerID="60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed"
Oct 30 20:39:06.711432 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.711394    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed"} err="failed to get container status \"60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed\": rpc error: code = NotFound desc = could not find container \"60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed\": container with ID starting with 60fc4f3f63c69c92f5862bc12478b5e15bb39283152b85835aff6c18e6a69bed not found: ID does not exist"
Oct 30 20:39:06.711432 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.711416    6015 scope.go:122] "RemoveContainer" containerID="e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02"
Oct 30 20:39:06.711680 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:39:06.711660    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02\": container with ID starting with e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02 not found: ID does not exist" containerID="e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02"
Oct 30 20:39:06.711723 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.711686    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02"} err="failed to get container status \"e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02\": rpc error: code = NotFound desc = could not find container \"e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02\": container with ID starting with e7a1ac9aa61dde3bab2c7d63c01db08ab4244c550c33fa323306b7e3952a0e02 not found: ID does not exist"
Oct 30 20:39:06.853998 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.853961    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"]
Oct 30 20:39:06.860676 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:06.860637    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-e4864d-openshift-default-75c55dc5f5-97hhr"]
Oct 30 20:39:07.585067 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:07.585023    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" path="/var/lib/kubelet/pods/88448a71-1695-4c8e-9eea-7acf648d9f0f/volumes"
Oct 30 20:39:09.184947 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:09.184910    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:10.040540 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:10.040496    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:10.677496 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:10.677456    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:10.885834 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:10.885771    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:13.962608 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:13.962547    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:14.172345 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:14.172306    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:14.350784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:14.350748    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:14.655430 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:14.655334    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:16.771135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:16.771050    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:16.937824 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:16.937771    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:18.614122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:18.614085    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"]
Oct 30 20:39:18.719795 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:18.719757    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"]
Oct 30 20:39:19.010613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:19.010522    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:19.181157 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:19.181109    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:19.418570 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:19.418538    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:21.053518 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.053457    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn" podUID="23b6d445-7b28-4f9f-aecc-874ff146099e" containerName="main" containerID="cri-o://b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e" gracePeriod=45
Oct 30 20:39:21.087626 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:39:21.087583    6015 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23b6d445_7b28_4f9f_aecc_874ff146099e.slice/crio-b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 20:39:21.316818 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.316728    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 20:39:21.364928 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.364894    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-tmp-dir\") pod \"23b6d445-7b28-4f9f-aecc-874ff146099e\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") "
Oct 30 20:39:21.365115 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.365053    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-model-cache\") pod \"23b6d445-7b28-4f9f-aecc-874ff146099e\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") "
Oct 30 20:39:21.365184 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.365161    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/23b6d445-7b28-4f9f-aecc-874ff146099e-tls-certs\" (UniqueName: \"kubernetes.io/secret/23b6d445-7b28-4f9f-aecc-874ff146099e-tls-certs\") pod \"23b6d445-7b28-4f9f-aecc-874ff146099e\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") "
Oct 30 20:39:21.365245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.365197    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23b6d445-7b28-4f9f-aecc-874ff146099e-kube-api-access-xlv28\" (UniqueName: \"kubernetes.io/projected/23b6d445-7b28-4f9f-aecc-874ff146099e-kube-api-access-xlv28\") pod \"23b6d445-7b28-4f9f-aecc-874ff146099e\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") "
Oct 30 20:39:21.365245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.365213    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-tmp-dir" pod "23b6d445-7b28-4f9f-aecc-874ff146099e" (UID: "23b6d445-7b28-4f9f-aecc-874ff146099e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:21.365245 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.365237    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-home\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-home\") pod \"23b6d445-7b28-4f9f-aecc-874ff146099e\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") "
Oct 30 20:39:21.365428 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.365352    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-model-cache" pod "23b6d445-7b28-4f9f-aecc-874ff146099e" (UID: "23b6d445-7b28-4f9f-aecc-874ff146099e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:21.365473 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.365420    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-dshm\") pod \"23b6d445-7b28-4f9f-aecc-874ff146099e\" (UID: \"23b6d445-7b28-4f9f-aecc-874ff146099e\") "
Oct 30 20:39:21.365473 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.365450    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-home" pod "23b6d445-7b28-4f9f-aecc-874ff146099e" (UID: "23b6d445-7b28-4f9f-aecc-874ff146099e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:21.365832 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.365787    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:21.365965 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.365840    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:21.365965 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.365854    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:21.367701 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.367672    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23b6d445-7b28-4f9f-aecc-874ff146099e-kube-api-access-xlv28" pod "23b6d445-7b28-4f9f-aecc-874ff146099e" (UID: "23b6d445-7b28-4f9f-aecc-874ff146099e"). InnerVolumeSpecName "kube-api-access-xlv28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:21.367701 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.367696    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-dshm" pod "23b6d445-7b28-4f9f-aecc-874ff146099e" (UID: "23b6d445-7b28-4f9f-aecc-874ff146099e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:39:21.367972 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.367950    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23b6d445-7b28-4f9f-aecc-874ff146099e-tls-certs" pod "23b6d445-7b28-4f9f-aecc-874ff146099e" (UID: "23b6d445-7b28-4f9f-aecc-874ff146099e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:39:21.460635 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.460596    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:21.466821 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.466782    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23b6d445-7b28-4f9f-aecc-874ff146099e-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:21.466961 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.466842    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlv28\" (UniqueName: \"kubernetes.io/projected/23b6d445-7b28-4f9f-aecc-874ff146099e-kube-api-access-xlv28\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:21.466961 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.466853    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b6d445-7b28-4f9f-aecc-874ff146099e-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:21.779396 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.779361    6015 generic.go:356] "Generic (PLEG): container finished" podID="23b6d445-7b28-4f9f-aecc-874ff146099e" containerID="b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e" exitCode=0
Oct 30 20:39:21.779596 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.779407    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"
Oct 30 20:39:21.779596 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.779439    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn" event={"ID":"23b6d445-7b28-4f9f-aecc-874ff146099e","Type":"ContainerDied","Data":"b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e"}
Oct 30 20:39:21.779596 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.779483    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn" event={"ID":"23b6d445-7b28-4f9f-aecc-874ff146099e","Type":"ContainerDied","Data":"9e25ff74d656e6594c97b49c0b531e0a486e441f94c8c60d57c1ca09d41f4ccf"}
Oct 30 20:39:21.779596 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.779506    6015 scope.go:122] "RemoveContainer" containerID="b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e"
Oct 30 20:39:21.788787 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.788762    6015 scope.go:122] "RemoveContainer" containerID="b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e"
Oct 30 20:39:21.789112 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:39:21.789092    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e\": container with ID starting with b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e not found: ID does not exist" containerID="b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e"
Oct 30 20:39:21.789191 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.789126    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e"} err="failed to get container status \"b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e\": rpc error: code = NotFound desc = could not find container \"b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e\": container with ID starting with b3533b02f292267b8516b96914b0d6565fb27280cbf7f87262d499877548d59e not found: ID does not exist"
Oct 30 20:39:21.936284 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.936191    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"]
Oct 30 20:39:21.940389 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:21.940359    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a74d15/distinct-w0-a74d15-kserve-7855c49875-jgjkn"]
Oct 30 20:39:22.743705 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:22.743657    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:22.898061 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:22.898023    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:23.585404 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:23.585362    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23b6d445-7b28-4f9f-aecc-874ff146099e" path="/var/lib/kubelet/pods/23b6d445-7b28-4f9f-aecc-874ff146099e/volumes"
Oct 30 20:39:23.614736 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:23.614692    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg" podUID="79d59373-dd54-4099-9aa8-95b27ebb3ca8" containerName="payload-processing" containerID="cri-o://dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08" gracePeriod=25
Oct 30 20:39:23.720657 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:23.720597    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j" podUID="b0ae637e-40fc-4735-ae1f-d572a97b528d" containerName="payload-pre-processing" containerID="cri-o://5f1459bbc5d00b28005c52002e37c8c43ce0dfa95e584f8b6b4aacf355854897" gracePeriod=25
Oct 30 20:39:24.850191 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:24.850146    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:28.217012 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:39:28.216975    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:39:29.417666 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:29.417621    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j" podUID="b0ae637e-40fc-4735-ae1f-d572a97b528d" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:39:30.001915 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:30.001871    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:30.424195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:30.424158    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg" podUID="79d59373-dd54-4099-9aa8-95b27ebb3ca8" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:39:35.225422 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:35.225388    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:36.833896 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:36.833856    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:37.034901 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:37.034868    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:37.616005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:37.615964    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:39.279131 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:39.279099    6015 scope.go:122] "RemoveContainer" containerID="cdb6c70d4ec6c71a2cdc16253c388ca17c366d098a60075222fcc884f6f46cd7"
Oct 30 20:39:39.417125 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:39.417087    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j" podUID="b0ae637e-40fc-4735-ae1f-d572a97b528d" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:39:40.310721 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:40.310686    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:40.424261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:40.424223    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg" podUID="79d59373-dd54-4099-9aa8-95b27ebb3ca8" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:39:43.765119 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.765082    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:43.902677 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.902643    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 20:39:43.924608 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.921267    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79d59373-dd54-4099-9aa8-95b27ebb3ca8-kube-api-access-6qtgn\" (UniqueName: \"kubernetes.io/projected/79d59373-dd54-4099-9aa8-95b27ebb3ca8-kube-api-access-6qtgn\") pod \"79d59373-dd54-4099-9aa8-95b27ebb3ca8\" (UID: \"79d59373-dd54-4099-9aa8-95b27ebb3ca8\") "
Oct 30 20:39:43.924608 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.921382    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/79d59373-dd54-4099-9aa8-95b27ebb3ca8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79d59373-dd54-4099-9aa8-95b27ebb3ca8-plugins-config-volume\") pod \"79d59373-dd54-4099-9aa8-95b27ebb3ca8\" (UID: \"79d59373-dd54-4099-9aa8-95b27ebb3ca8\") "
Oct 30 20:39:43.924608 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.921835    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79d59373-dd54-4099-9aa8-95b27ebb3ca8-plugins-config-volume" pod "79d59373-dd54-4099-9aa8-95b27ebb3ca8" (UID: "79d59373-dd54-4099-9aa8-95b27ebb3ca8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:43.928387 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.927735    6015 generic.go:356] "Generic (PLEG): container finished" podID="79d59373-dd54-4099-9aa8-95b27ebb3ca8" containerID="dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08" exitCode=0
Oct 30 20:39:43.928387 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.927975    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg" event={"ID":"79d59373-dd54-4099-9aa8-95b27ebb3ca8","Type":"ContainerDied","Data":"dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08"}
Oct 30 20:39:43.928387 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.928034    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg" event={"ID":"79d59373-dd54-4099-9aa8-95b27ebb3ca8","Type":"ContainerDied","Data":"4371c25d6595475c1ffdd6db5ee6fe4b5a5b0202694b5ba564fc2b4746ef508d"}
Oct 30 20:39:43.928387 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.928065    6015 scope.go:122] "RemoveContainer" containerID="dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08"
Oct 30 20:39:43.928387 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.928217    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"
Oct 30 20:39:43.933602 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.933557    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79d59373-dd54-4099-9aa8-95b27ebb3ca8-kube-api-access-6qtgn" pod "79d59373-dd54-4099-9aa8-95b27ebb3ca8" (UID: "79d59373-dd54-4099-9aa8-95b27ebb3ca8"). InnerVolumeSpecName "kube-api-access-6qtgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:43.935012 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.934981    6015 generic.go:356] "Generic (PLEG): container finished" podID="b0ae637e-40fc-4735-ae1f-d572a97b528d" containerID="5f1459bbc5d00b28005c52002e37c8c43ce0dfa95e584f8b6b4aacf355854897" exitCode=0
Oct 30 20:39:43.935161 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.935041    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j" event={"ID":"b0ae637e-40fc-4735-ae1f-d572a97b528d","Type":"ContainerDied","Data":"5f1459bbc5d00b28005c52002e37c8c43ce0dfa95e584f8b6b4aacf355854897"}
Oct 30 20:39:43.954669 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.954643    6015 scope.go:122] "RemoveContainer" containerID="dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08"
Oct 30 20:39:43.955231 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:39:43.955206    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08\": container with ID starting with dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08 not found: ID does not exist" containerID="dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08"
Oct 30 20:39:43.955326 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.955246    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08"} err="failed to get container status \"dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08\": rpc error: code = NotFound desc = could not find container \"dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08\": container with ID starting with dba45bff820dc1d29fe9f5aedbff0a3e4ef5f3a5f72246ff76a1a099eea4ea08 not found: ID does not exist"
Oct 30 20:39:43.984006 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:43.983927    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 20:39:44.023053 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.023017    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0ae637e-40fc-4735-ae1f-d572a97b528d-kube-api-access-zzb7h\" (UniqueName: \"kubernetes.io/projected/b0ae637e-40fc-4735-ae1f-d572a97b528d-kube-api-access-zzb7h\") pod \"b0ae637e-40fc-4735-ae1f-d572a97b528d\" (UID: \"b0ae637e-40fc-4735-ae1f-d572a97b528d\") "
Oct 30 20:39:44.023259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.023075    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b0ae637e-40fc-4735-ae1f-d572a97b528d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0ae637e-40fc-4735-ae1f-d572a97b528d-plugins-config-volume\") pod \"b0ae637e-40fc-4735-ae1f-d572a97b528d\" (UID: \"b0ae637e-40fc-4735-ae1f-d572a97b528d\") "
Oct 30 20:39:44.023584 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.023562    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qtgn\" (UniqueName: \"kubernetes.io/projected/79d59373-dd54-4099-9aa8-95b27ebb3ca8-kube-api-access-6qtgn\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:44.023669 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.023589    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79d59373-dd54-4099-9aa8-95b27ebb3ca8-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:44.025948 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.025910    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ae637e-40fc-4735-ae1f-d572a97b528d-kube-api-access-zzb7h" pod "b0ae637e-40fc-4735-ae1f-d572a97b528d" (UID: "b0ae637e-40fc-4735-ae1f-d572a97b528d"). InnerVolumeSpecName "kube-api-access-zzb7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:39:44.026995 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.026973    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ae637e-40fc-4735-ae1f-d572a97b528d-plugins-config-volume" pod "b0ae637e-40fc-4735-ae1f-d572a97b528d" (UID: "b0ae637e-40fc-4735-ae1f-d572a97b528d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:39:44.124239 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.124159    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzb7h\" (UniqueName: \"kubernetes.io/projected/b0ae637e-40fc-4735-ae1f-d572a97b528d-kube-api-access-zzb7h\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:44.124239 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.124187    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0ae637e-40fc-4735-ae1f-d572a97b528d-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:39:44.353058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.353023    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"]
Oct 30 20:39:44.356262 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.356234    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a74d15-d9bf795c4-rqfsg"]
Oct 30 20:39:44.628872 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.628798    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:44.942495 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.942393    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"
Oct 30 20:39:44.942495 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.942415    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j" event={"ID":"b0ae637e-40fc-4735-ae1f-d572a97b528d","Type":"ContainerDied","Data":"d579e9ca9f8f6a2f69ff0bcde70094d755118a44ef94feb6c021404d69011a84"}
Oct 30 20:39:44.942495 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:44.942482    6015 scope.go:122] "RemoveContainer" containerID="5f1459bbc5d00b28005c52002e37c8c43ce0dfa95e584f8b6b4aacf355854897"
Oct 30 20:39:45.100335 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:45.100300    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"]
Oct 30 20:39:45.105955 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:45.105923    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a74d15-d494c49f9-6dn2j"]
Oct 30 20:39:45.241428 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:45.241354    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:45.406641 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:45.406607    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:45.567577 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:45.567537    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:45.584202 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:45.584174    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79d59373-dd54-4099-9aa8-95b27ebb3ca8" path="/var/lib/kubelet/pods/79d59373-dd54-4099-9aa8-95b27ebb3ca8/volumes"
Oct 30 20:39:45.584568 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:45.584555    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b0ae637e-40fc-4735-ae1f-d572a97b528d" path="/var/lib/kubelet/pods/b0ae637e-40fc-4735-ae1f-d572a97b528d/volumes"
Oct 30 20:39:45.745547 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:45.745509    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:50.599745 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:50.599702    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:52.845773 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:52.845735    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:53.029323 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:53.029280    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:53.577682 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:53.577639    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:53.813591 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:53.813542    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:55.967587 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:39:55.967547    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:39:58.215415 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:39:58.215375    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:40:00.596921 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:00.596881    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"]
Oct 30 20:40:00.597428 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:00.597079    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm" podUID="0d2a4c5c-7251-45b8-a501-fea6546bc5d7" containerName="maas-api" containerID="cri-o://b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8" gracePeriod=30
Oct 30 20:40:00.706128 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:00.706087    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:00.877382 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:00.877354    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 20:40:01.013409 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.013372    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-openshift-service-ca\") pod \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") "
Oct 30 20:40:01.013613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.013437    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-maas-api-tls\") pod \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") "
Oct 30 20:40:01.013613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.013498    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-metrics-certs\") pod \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") "
Oct 30 20:40:01.013613 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.013580    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-kube-api-access-l6m29\" (UniqueName: \"kubernetes.io/projected/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-kube-api-access-l6m29\") pod \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\" (UID: \"0d2a4c5c-7251-45b8-a501-fea6546bc5d7\") "
Oct 30 20:40:01.013908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.013873    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-openshift-service-ca" pod "0d2a4c5c-7251-45b8-a501-fea6546bc5d7" (UID: "0d2a4c5c-7251-45b8-a501-fea6546bc5d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:01.014075 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.014054    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.015983 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.015955    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-metrics-certs" pod "0d2a4c5c-7251-45b8-a501-fea6546bc5d7" (UID: "0d2a4c5c-7251-45b8-a501-fea6546bc5d7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:01.016115 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.016010    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-maas-api-tls" pod "0d2a4c5c-7251-45b8-a501-fea6546bc5d7" (UID: "0d2a4c5c-7251-45b8-a501-fea6546bc5d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:01.016190 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.016149    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-kube-api-access-l6m29" pod "0d2a4c5c-7251-45b8-a501-fea6546bc5d7" (UID: "0d2a4c5c-7251-45b8-a501-fea6546bc5d7"). InnerVolumeSpecName "kube-api-access-l6m29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:01.039697 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.039658    6015 generic.go:356] "Generic (PLEG): container finished" podID="0d2a4c5c-7251-45b8-a501-fea6546bc5d7" containerID="b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8" exitCode=0
Oct 30 20:40:01.039895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.039706    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"
Oct 30 20:40:01.039895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.039744    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm" event={"ID":"0d2a4c5c-7251-45b8-a501-fea6546bc5d7","Type":"ContainerDied","Data":"b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8"}
Oct 30 20:40:01.039895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.039848    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm" event={"ID":"0d2a4c5c-7251-45b8-a501-fea6546bc5d7","Type":"ContainerDied","Data":"9721233d00614008d1680ef3044fafb5771d835cf250327e8aa18a79b66e2e8b"}
Oct 30 20:40:01.039895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.039877    6015 scope.go:122] "RemoveContainer" containerID="b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8"
Oct 30 20:40:01.050711 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.050683    6015 scope.go:122] "RemoveContainer" containerID="b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8"
Oct 30 20:40:01.051029 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:40:01.051009    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8\": container with ID starting with b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8 not found: ID does not exist" containerID="b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8"
Oct 30 20:40:01.051104 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.051042    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8"} err="failed to get container status \"b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8\": rpc error: code = NotFound desc = could not find container \"b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8\": container with ID starting with b594b5cdedfc6cb724c258c21dcf85ab9d331ecce4a5b87b9a7292bb64c140c8 not found: ID does not exist"
Oct 30 20:40:01.115091 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.114989    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.115091 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.115028    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.115091 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.115042    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6m29\" (UniqueName: \"kubernetes.io/projected/0d2a4c5c-7251-45b8-a501-fea6546bc5d7-kube-api-access-l6m29\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:01.197521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.197489    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"]
Oct 30 20:40:01.201363 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.201336    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a74d15-ffdbcc448-p6fjm"]
Oct 30 20:40:01.584974 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:01.584940    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d2a4c5c-7251-45b8-a501-fea6546bc5d7" path="/var/lib/kubelet/pods/0d2a4c5c-7251-45b8-a501-fea6546bc5d7/volumes"
Oct 30 20:40:02.280111 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:02.280058    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:02.514780 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:02.514740    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:02.666225 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:02.666182    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:03.213038 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:03.212997    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:04.465843 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:04.465789    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:04.917758 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:04.917722    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"]
Oct 30 20:40:05.029210 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:05.029176    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"]
Oct 30 20:40:05.298346 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:05.298305    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:05.451037 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:05.450995    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:07.989334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:07.989291    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:09.643539 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:09.643502    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:09.793407 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:09.793367    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:09.918509 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:09.918402    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls" podUID="41370641-dd3b-4349-b909-64bec93bc378" containerName="payload-processing" containerID="cri-o://f776c4b6994a1d4ff3bad68fd124cbdfcec3789ee00be823bbdce647545c7f24" gracePeriod=25
Oct 30 20:40:09.997316 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:09.997277    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:10.029915 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.029872    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt" podUID="9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c" containerName="payload-pre-processing" containerID="cri-o://bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19" gracePeriod=25
Oct 30 20:40:10.095986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.095955    6015 generic.go:356] "Generic (PLEG): container finished" podID="41370641-dd3b-4349-b909-64bec93bc378" containerID="f776c4b6994a1d4ff3bad68fd124cbdfcec3789ee00be823bbdce647545c7f24" exitCode=0
Oct 30 20:40:10.096169 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.096029    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls" event={"ID":"41370641-dd3b-4349-b909-64bec93bc378","Type":"ContainerDied","Data":"f776c4b6994a1d4ff3bad68fd124cbdfcec3789ee00be823bbdce647545c7f24"}
Oct 30 20:40:10.184462 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.184383    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:40:10.216794 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.215886    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/41370641-dd3b-4349-b909-64bec93bc378-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41370641-dd3b-4349-b909-64bec93bc378-plugins-config-volume\") pod \"41370641-dd3b-4349-b909-64bec93bc378\" (UID: \"41370641-dd3b-4349-b909-64bec93bc378\") "
Oct 30 20:40:10.216794 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.215993    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/41370641-dd3b-4349-b909-64bec93bc378-kube-api-access-m8l67\" (UniqueName: \"kubernetes.io/projected/41370641-dd3b-4349-b909-64bec93bc378-kube-api-access-m8l67\") pod \"41370641-dd3b-4349-b909-64bec93bc378\" (UID: \"41370641-dd3b-4349-b909-64bec93bc378\") "
Oct 30 20:40:10.217333 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.216895    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41370641-dd3b-4349-b909-64bec93bc378-plugins-config-volume" pod "41370641-dd3b-4349-b909-64bec93bc378" (UID: "41370641-dd3b-4349-b909-64bec93bc378"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:10.219314 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.219290    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41370641-dd3b-4349-b909-64bec93bc378-kube-api-access-m8l67" pod "41370641-dd3b-4349-b909-64bec93bc378" (UID: "41370641-dd3b-4349-b909-64bec93bc378"). InnerVolumeSpecName "kube-api-access-m8l67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:10.283883 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.283854    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:40:10.316988 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.316954    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-kube-api-access-5crlw\" (UniqueName: \"kubernetes.io/projected/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-kube-api-access-5crlw\") pod \"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c\" (UID: \"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c\") "
Oct 30 20:40:10.317184 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.317000    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-plugins-config-volume\") pod \"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c\" (UID: \"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c\") "
Oct 30 20:40:10.317340 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.317327    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8l67\" (UniqueName: \"kubernetes.io/projected/41370641-dd3b-4349-b909-64bec93bc378-kube-api-access-m8l67\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:10.317395 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.317343    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41370641-dd3b-4349-b909-64bec93bc378-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:10.317504 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.317476    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-plugins-config-volume" pod "9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c" (UID: "9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:10.319508 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.319482    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-kube-api-access-5crlw" pod "9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c" (UID: "9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c"). InnerVolumeSpecName "kube-api-access-5crlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:10.418413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.418379    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5crlw\" (UniqueName: \"kubernetes.io/projected/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-kube-api-access-5crlw\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:10.418413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:10.418406    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:11.102391 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.102352    6015 generic.go:356] "Generic (PLEG): container finished" podID="9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c" containerID="bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19" exitCode=0
Oct 30 20:40:11.102902 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.102401    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"
Oct 30 20:40:11.102902 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.102437    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt" event={"ID":"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c","Type":"ContainerDied","Data":"bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19"}
Oct 30 20:40:11.102902 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.102488    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt" event={"ID":"9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c","Type":"ContainerDied","Data":"0290d4aa76f507bc022307c397b23d6441caa5e7a8488d602080181754176e1f"}
Oct 30 20:40:11.102902 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.102517    6015 scope.go:122] "RemoveContainer" containerID="bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19"
Oct 30 20:40:11.104023 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.104007    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"
Oct 30 20:40:11.104023 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.104011    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls" event={"ID":"41370641-dd3b-4349-b909-64bec93bc378","Type":"ContainerDied","Data":"73da8b8f5f10aed84d2f6b245dabe6c334982f2d8168489c273671123b92c575"}
Oct 30 20:40:11.114553 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.114526    6015 scope.go:122] "RemoveContainer" containerID="bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19"
Oct 30 20:40:11.115015 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:40:11.114986    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19\": container with ID starting with bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19 not found: ID does not exist" containerID="bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19"
Oct 30 20:40:11.115108 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.115026    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19"} err="failed to get container status \"bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19\": rpc error: code = NotFound desc = could not find container \"bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19\": container with ID starting with bf80a462b25e92a2d2217467c966c06704c3acd9d1c3040736e82cd9d851fc19 not found: ID does not exist"
Oct 30 20:40:11.115108 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.115050    6015 scope.go:122] "RemoveContainer" containerID="f776c4b6994a1d4ff3bad68fd124cbdfcec3789ee00be823bbdce647545c7f24"
Oct 30 20:40:11.261043 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.260950    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"]
Oct 30 20:40:11.307796 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.307757    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-46dadd-568755f8cf-n55vt"]
Oct 30 20:40:11.374847 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.374752    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"]
Oct 30 20:40:11.383966 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.383930    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-46dadd-6f9b4797d-znhls"]
Oct 30 20:40:11.585666 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.585634    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="41370641-dd3b-4349-b909-64bec93bc378" path="/var/lib/kubelet/pods/41370641-dd3b-4349-b909-64bec93bc378/volumes"
Oct 30 20:40:11.586143 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:11.586126    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c" path="/var/lib/kubelet/pods/9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c/volumes"
Oct 30 20:40:12.997368 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:12.997334    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:18.011327 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:18.011292    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:22.358731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:22.358698    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:23.936173 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:23.936137    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:25.664142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:25.664096    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:28.217674 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:40:28.217630    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:40:29.623823 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:29.623763    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:31.186913 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:31.186839    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:31.341835 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:31.341784    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:31.530952 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:31.530872    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"]
Oct 30 20:40:31.531135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:31.531112    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy" containerID="cri-o://d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060" gracePeriod=30
Oct 30 20:40:31.542151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:31.542110    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:33.935856 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:33.935788    6015 patch_prober.go:29] interesting pod/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:40:33.936248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:33.935889    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:40:35.052359 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:35.052304    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:36.816416 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.816385    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:40:36.909445 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.909402    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-podinfo\") pod \"2d00166f-5e3a-416e-8b21-d5a30638c025\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") "
Oct 30 20:40:36.909649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.909457    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d00166f-5e3a-416e-8b21-d5a30638c025-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d00166f-5e3a-416e-8b21-d5a30638c025-istiod-ca-cert\") pod \"2d00166f-5e3a-416e-8b21-d5a30638c025\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") "
Oct 30 20:40:36.909649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.909507    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-credential-socket\") pod \"2d00166f-5e3a-416e-8b21-d5a30638c025\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") "
Oct 30 20:40:36.909649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.909550    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-certs\") pod \"2d00166f-5e3a-416e-8b21-d5a30638c025\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") "
Oct 30 20:40:36.909649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.909590    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-envoy\") pod \"2d00166f-5e3a-416e-8b21-d5a30638c025\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") "
Oct 30 20:40:36.909649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.909618    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-socket\") pod \"2d00166f-5e3a-416e-8b21-d5a30638c025\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") "
Oct 30 20:40:36.909957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.909686    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-data\") pod \"2d00166f-5e3a-416e-8b21-d5a30638c025\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") "
Oct 30 20:40:36.909957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.909727    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-kube-api-access-kcn76\" (UniqueName: \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-kube-api-access-kcn76\") pod \"2d00166f-5e3a-416e-8b21-d5a30638c025\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") "
Oct 30 20:40:36.909957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.909762    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-token\" (UniqueName: \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-token\") pod \"2d00166f-5e3a-416e-8b21-d5a30638c025\" (UID: \"2d00166f-5e3a-416e-8b21-d5a30638c025\") "
Oct 30 20:40:36.909957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.909868    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d00166f-5e3a-416e-8b21-d5a30638c025-istiod-ca-cert" pod "2d00166f-5e3a-416e-8b21-d5a30638c025" (UID: "2d00166f-5e3a-416e-8b21-d5a30638c025"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:36.909957 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.909919    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-credential-socket" pod "2d00166f-5e3a-416e-8b21-d5a30638c025" (UID: "2d00166f-5e3a-416e-8b21-d5a30638c025"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:40:36.910250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.910188    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-certs" pod "2d00166f-5e3a-416e-8b21-d5a30638c025" (UID: "2d00166f-5e3a-416e-8b21-d5a30638c025"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:40:36.910250 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.910202    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-data" pod "2d00166f-5e3a-416e-8b21-d5a30638c025" (UID: "2d00166f-5e3a-416e-8b21-d5a30638c025"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:40:36.910439 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.910416    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-socket" pod "2d00166f-5e3a-416e-8b21-d5a30638c025" (UID: "2d00166f-5e3a-416e-8b21-d5a30638c025"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:40:36.910685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.910578    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:36.910685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.910625    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d00166f-5e3a-416e-8b21-d5a30638c025-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:36.910685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.910641    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:36.910685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.910658    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:36.912248 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.912198    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-podinfo" pod "2d00166f-5e3a-416e-8b21-d5a30638c025" (UID: "2d00166f-5e3a-416e-8b21-d5a30638c025"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:40:36.912388 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.912251    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-kube-api-access-kcn76" pod "2d00166f-5e3a-416e-8b21-d5a30638c025" (UID: "2d00166f-5e3a-416e-8b21-d5a30638c025"). InnerVolumeSpecName "kube-api-access-kcn76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:36.912739 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.912657    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-envoy" pod "2d00166f-5e3a-416e-8b21-d5a30638c025" (UID: "2d00166f-5e3a-416e-8b21-d5a30638c025"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:40:36.912864 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:36.912824    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-token" pod "2d00166f-5e3a-416e-8b21-d5a30638c025" (UID: "2d00166f-5e3a-416e-8b21-d5a30638c025"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:37.011590 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.011553    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:37.011590 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.011589    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:37.011840 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.011602    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00166f-5e3a-416e-8b21-d5a30638c025-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:37.011840 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.011615    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcn76\" (UniqueName: \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-kube-api-access-kcn76\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:37.011840 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.011629    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d00166f-5e3a-416e-8b21-d5a30638c025-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:37.256024 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.255939    6015 generic.go:356] "Generic (PLEG): container finished" podID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerID="d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060" exitCode=0
Oct 30 20:40:37.256024 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.255992    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"
Oct 30 20:40:37.256221 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.256025    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" event={"ID":"2d00166f-5e3a-416e-8b21-d5a30638c025","Type":"ContainerDied","Data":"d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060"}
Oct 30 20:40:37.256221 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.256085    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6" event={"ID":"2d00166f-5e3a-416e-8b21-d5a30638c025","Type":"ContainerDied","Data":"3510a672ff191082fca96a40d6758e8ce80a29c97d883c23ef54c356ecf8781f"}
Oct 30 20:40:37.256221 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.256113    6015 scope.go:122] "RemoveContainer" containerID="d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060"
Oct 30 20:40:37.276908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.276866    6015 scope.go:122] "RemoveContainer" containerID="008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed"
Oct 30 20:40:37.290984 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.290950    6015 scope.go:122] "RemoveContainer" containerID="d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060"
Oct 30 20:40:37.291372 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:40:37.291349    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060\": container with ID starting with d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060 not found: ID does not exist" containerID="d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060"
Oct 30 20:40:37.291449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.291383    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060"} err="failed to get container status \"d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060\": rpc error: code = NotFound desc = could not find container \"d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060\": container with ID starting with d69909651b812137720c26dc7bbd628b7ead328f295c42ef7214eb44cb7c0060 not found: ID does not exist"
Oct 30 20:40:37.291449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.291405    6015 scope.go:122] "RemoveContainer" containerID="008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed"
Oct 30 20:40:37.291733 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:40:37.291717    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed\": container with ID starting with 008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed not found: ID does not exist" containerID="008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed"
Oct 30 20:40:37.291792 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.291738    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed"} err="failed to get container status \"008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed\": rpc error: code = NotFound desc = could not find container \"008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed\": container with ID starting with 008a00d72d4092a4dbb6df73b30354867c1c11904088400bc4adc201283475ed not found: ID does not exist"
Oct 30 20:40:37.414408 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.414372    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"]
Oct 30 20:40:37.461172 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.461132    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-a-46dadd-openshift-default-5d8878cbbf-d2df6"]
Oct 30 20:40:37.587597 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:37.587560    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" path="/var/lib/kubelet/pods/2d00166f-5e3a-416e-8b21-d5a30638c025/volumes"
Oct 30 20:40:39.313384 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:39.313351    6015 scope.go:122] "RemoveContainer" containerID="e3399ba8a1ad4871f5409ea9adbce801d9068854f5fc43fd26319c5fd384fad8"
Oct 30 20:40:39.322449 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:39.322425    6015 scope.go:122] "RemoveContainer" containerID="44ac89b71d051e424223c9ce7d19096844e4f445636139200d6df17cd891c0f1"
Oct 30 20:40:40.318965 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:40.318930    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:43.953800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:43.953763    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"]
Oct 30 20:40:44.116371 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:44.116326    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"]
Oct 30 20:40:44.350498 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:44.350462    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:44.499680 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:44.499643    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:45.422200 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:45.422160    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:48.103240 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:48.103144    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:48.263064 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:48.263016    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:48.954902 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:48.954831    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr" podUID="bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad" containerName="payload-processing" containerID="cri-o://0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5" gracePeriod=25
Oct 30 20:40:49.117063 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:49.117013    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2" podUID="71d80089-5efc-425c-991c-31cf7f7854e8" containerName="payload-pre-processing" containerID="cri-o://095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b" gracePeriod=25
Oct 30 20:40:49.813339 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:49.813287    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:49.969520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:49.969481    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:51.372903 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:51.372863    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:51.609604 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:51.609551    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:51.759101 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:51.759020    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:52.341178 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:52.341140    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:57.076940 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:57.076896    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:57.742524 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:57.742490    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2" podUID="71d80089-5efc-425c-991c-31cf7f7854e8" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:40:57.743482 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:57.743456    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr" podUID="bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:40:58.219263 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:40:58.219221    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:40:58.866024 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:58.865982    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:59.066105 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:59.066062    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:40:59.195877 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:59.195772    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"]
Oct 30 20:40:59.196035 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:59.196011    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy" containerID="cri-o://069fc408baeb1426afad65aec4a6a8d73434dd940c5ee8acc1bfaca8edd690c7" gracePeriod=30
Oct 30 20:40:59.229952 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:40:59.229907    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:02.430251 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:02.430206    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:04.413884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.413854    6015 generic.go:356] "Generic (PLEG): container finished" podID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerID="069fc408baeb1426afad65aec4a6a8d73434dd940c5ee8acc1bfaca8edd690c7" exitCode=0
Oct 30 20:41:04.414418 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.413984    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" event={"ID":"696e031c-3499-48ce-a9dd-dc02da84d95e","Type":"ContainerDied","Data":"069fc408baeb1426afad65aec4a6a8d73434dd940c5ee8acc1bfaca8edd690c7"}
Oct 30 20:41:04.414418 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.414031    6015 scope.go:122] "RemoveContainer" containerID="9c1d8f36988fa93a42cf9a510445ec08422f17a9da79ef0a4a64b3632c8b0151"
Oct 30 20:41:04.454826 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.454775    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:41:04.615744 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.615707    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-certs\") pod \"696e031c-3499-48ce-a9dd-dc02da84d95e\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") "
Oct 30 20:41:04.615985 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.615799    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-socket\") pod \"696e031c-3499-48ce-a9dd-dc02da84d95e\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") "
Oct 30 20:41:04.615985 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.615865    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-podinfo\") pod \"696e031c-3499-48ce-a9dd-dc02da84d95e\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") "
Oct 30 20:41:04.615985 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.615891    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-token\" (UniqueName: \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-token\") pod \"696e031c-3499-48ce-a9dd-dc02da84d95e\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") "
Oct 30 20:41:04.615985 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.615927    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-envoy\") pod \"696e031c-3499-48ce-a9dd-dc02da84d95e\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") "
Oct 30 20:41:04.615985 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.615977    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-credential-socket\") pod \"696e031c-3499-48ce-a9dd-dc02da84d95e\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") "
Oct 30 20:41:04.616274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.616003    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-kube-api-access-5xxcg\" (UniqueName: \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-kube-api-access-5xxcg\") pod \"696e031c-3499-48ce-a9dd-dc02da84d95e\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") "
Oct 30 20:41:04.616274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.616093    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-data\") pod \"696e031c-3499-48ce-a9dd-dc02da84d95e\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") "
Oct 30 20:41:04.616274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.616125    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/696e031c-3499-48ce-a9dd-dc02da84d95e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/696e031c-3499-48ce-a9dd-dc02da84d95e-istiod-ca-cert\") pod \"696e031c-3499-48ce-a9dd-dc02da84d95e\" (UID: \"696e031c-3499-48ce-a9dd-dc02da84d95e\") "
Oct 30 20:41:04.616274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.616091    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-certs" pod "696e031c-3499-48ce-a9dd-dc02da84d95e" (UID: "696e031c-3499-48ce-a9dd-dc02da84d95e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:41:04.616485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.616430    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-data" pod "696e031c-3499-48ce-a9dd-dc02da84d95e" (UID: "696e031c-3499-48ce-a9dd-dc02da84d95e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:41:04.616485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.616113    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-socket" pod "696e031c-3499-48ce-a9dd-dc02da84d95e" (UID: "696e031c-3499-48ce-a9dd-dc02da84d95e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:41:04.616599 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.616535    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-credential-socket" pod "696e031c-3499-48ce-a9dd-dc02da84d95e" (UID: "696e031c-3499-48ce-a9dd-dc02da84d95e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:41:04.616599 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.616563    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/696e031c-3499-48ce-a9dd-dc02da84d95e-istiod-ca-cert" pod "696e031c-3499-48ce-a9dd-dc02da84d95e" (UID: "696e031c-3499-48ce-a9dd-dc02da84d95e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:41:04.616746 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.616727    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:04.616839 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.616821    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:04.616904 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.616846    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:04.618464 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.618428    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-podinfo" pod "696e031c-3499-48ce-a9dd-dc02da84d95e" (UID: "696e031c-3499-48ce-a9dd-dc02da84d95e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:41:04.618569 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.618489    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-kube-api-access-5xxcg" pod "696e031c-3499-48ce-a9dd-dc02da84d95e" (UID: "696e031c-3499-48ce-a9dd-dc02da84d95e"). InnerVolumeSpecName "kube-api-access-5xxcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:41:04.618569 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.618530    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-token" pod "696e031c-3499-48ce-a9dd-dc02da84d95e" (UID: "696e031c-3499-48ce-a9dd-dc02da84d95e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:41:04.618675 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.618659    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-envoy" pod "696e031c-3499-48ce-a9dd-dc02da84d95e" (UID: "696e031c-3499-48ce-a9dd-dc02da84d95e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:41:04.717884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.717845    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:04.717884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.717877    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/696e031c-3499-48ce-a9dd-dc02da84d95e-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:04.717884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.717892    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xxcg\" (UniqueName: \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-kube-api-access-5xxcg\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:04.718142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.717907    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/696e031c-3499-48ce-a9dd-dc02da84d95e-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:04.718142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.717915    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:04.718142 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.717923    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/696e031c-3499-48ce-a9dd-dc02da84d95e-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:04.829450 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:04.829415    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:05.421266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:05.421233    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l" event={"ID":"696e031c-3499-48ce-a9dd-dc02da84d95e","Type":"ContainerDied","Data":"fe5c6d2e6508e7ed78193f7db26a88b0eaaf7ff3926bc0148038a9f908f2f7f7"}
Oct 30 20:41:05.421714 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:05.421290    6015 scope.go:122] "RemoveContainer" containerID="069fc408baeb1426afad65aec4a6a8d73434dd940c5ee8acc1bfaca8edd690c7"
Oct 30 20:41:05.421714 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:05.421242    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"
Oct 30 20:41:05.626629 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:05.626594    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"]
Oct 30 20:41:05.631409 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:05.631382    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-273c1b-openshift-default-5585576597-5wl5l"]
Oct 30 20:41:07.517815 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:07.517760    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:07.583910 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:07.583879    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" path="/var/lib/kubelet/pods/696e031c-3499-48ce-a9dd-dc02da84d95e/volumes"
Oct 30 20:41:07.742634 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:07.742588    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2" podUID="71d80089-5efc-425c-991c-31cf7f7854e8" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:41:07.743553 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:07.743522    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr" podUID="bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:41:07.922453 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:07.922411    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:09.246853 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.246821    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:41:09.267750 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.267695    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-plugins-config-volume\") pod \"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad\" (UID: \"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad\") "
Oct 30 20:41:09.267997 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.267841    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-kube-api-access-z42vs\" (UniqueName: \"kubernetes.io/projected/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-kube-api-access-z42vs\") pod \"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad\" (UID: \"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad\") "
Oct 30 20:41:09.268125 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.268087    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-plugins-config-volume" pod "bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad" (UID: "bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:41:09.268274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.268225    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:09.270461 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.270426    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-kube-api-access-z42vs" pod "bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad" (UID: "bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad"). InnerVolumeSpecName "kube-api-access-z42vs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:41:09.357651 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.357624    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:41:09.369431 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.369396    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71d80089-5efc-425c-991c-31cf7f7854e8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71d80089-5efc-425c-991c-31cf7f7854e8-plugins-config-volume\") pod \"71d80089-5efc-425c-991c-31cf7f7854e8\" (UID: \"71d80089-5efc-425c-991c-31cf7f7854e8\") "
Oct 30 20:41:09.369773 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.369753    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71d80089-5efc-425c-991c-31cf7f7854e8-kube-api-access-vnkh6\" (UniqueName: \"kubernetes.io/projected/71d80089-5efc-425c-991c-31cf7f7854e8-kube-api-access-vnkh6\") pod \"71d80089-5efc-425c-991c-31cf7f7854e8\" (UID: \"71d80089-5efc-425c-991c-31cf7f7854e8\") "
Oct 30 20:41:09.369917 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.369839    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71d80089-5efc-425c-991c-31cf7f7854e8-plugins-config-volume" pod "71d80089-5efc-425c-991c-31cf7f7854e8" (UID: "71d80089-5efc-425c-991c-31cf7f7854e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:41:09.370179 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.370157    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z42vs\" (UniqueName: \"kubernetes.io/projected/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad-kube-api-access-z42vs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:09.370258 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.370185    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71d80089-5efc-425c-991c-31cf7f7854e8-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:09.372048 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.372025    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d80089-5efc-425c-991c-31cf7f7854e8-kube-api-access-vnkh6" pod "71d80089-5efc-425c-991c-31cf7f7854e8" (UID: "71d80089-5efc-425c-991c-31cf7f7854e8"). InnerVolumeSpecName "kube-api-access-vnkh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:41:09.444154 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.444119    6015 generic.go:356] "Generic (PLEG): container finished" podID="71d80089-5efc-425c-991c-31cf7f7854e8" containerID="095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b" exitCode=0
Oct 30 20:41:09.444154 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.444158    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"
Oct 30 20:41:09.444392 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.444211    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2" event={"ID":"71d80089-5efc-425c-991c-31cf7f7854e8","Type":"ContainerDied","Data":"095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b"}
Oct 30 20:41:09.444392 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.444267    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2" event={"ID":"71d80089-5efc-425c-991c-31cf7f7854e8","Type":"ContainerDied","Data":"8090a7a9df57dd564194c59739e0546098af3423d4e7330918782258ea8374be"}
Oct 30 20:41:09.444392 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.444299    6015 scope.go:122] "RemoveContainer" containerID="095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b"
Oct 30 20:41:09.445967 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.445940    6015 generic.go:356] "Generic (PLEG): container finished" podID="bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad" containerID="0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5" exitCode=0
Oct 30 20:41:09.446121 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.445977    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr" event={"ID":"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad","Type":"ContainerDied","Data":"0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5"}
Oct 30 20:41:09.446121 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.445991    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"
Oct 30 20:41:09.446121 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.446026    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr" event={"ID":"bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad","Type":"ContainerDied","Data":"672d9bb02dc4a06faff1fa18e231ae1e704f135d7a5c0010d2e986c0364b29db"}
Oct 30 20:41:09.454466 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.454446    6015 scope.go:122] "RemoveContainer" containerID="095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b"
Oct 30 20:41:09.454787 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:41:09.454763    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b\": container with ID starting with 095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b not found: ID does not exist" containerID="095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b"
Oct 30 20:41:09.454908 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.454799    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b"} err="failed to get container status \"095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b\": rpc error: code = NotFound desc = could not find container \"095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b\": container with ID starting with 095270b13f634335f188e0a57821ad6f39ca4fc8a41f7a958dafba43e940fa6b not found: ID does not exist"
Oct 30 20:41:09.454987 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.454913    6015 scope.go:122] "RemoveContainer" containerID="0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5"
Oct 30 20:41:09.464136 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.464108    6015 scope.go:122] "RemoveContainer" containerID="0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5"
Oct 30 20:41:09.464489 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:41:09.464464    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5\": container with ID starting with 0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5 not found: ID does not exist" containerID="0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5"
Oct 30 20:41:09.464545 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.464499    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5"} err="failed to get container status \"0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5\": rpc error: code = NotFound desc = could not find container \"0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5\": container with ID starting with 0b2bc60406554a1e8eacd771902f76dbed94e982f5612c81aca739970684f2d5 not found: ID does not exist"
Oct 30 20:41:09.471303 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.471234    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnkh6\" (UniqueName: \"kubernetes.io/projected/71d80089-5efc-425c-991c-31cf7f7854e8-kube-api-access-vnkh6\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:09.585179 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.585145    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"]
Oct 30 20:41:09.589734 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.589701    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-273c1b-f5c4db9ff-2ffq2"]
Oct 30 20:41:09.694133 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.694091    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"]
Oct 30 20:41:09.698994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:09.698964    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-273c1b-7df95585d6-8ffvr"]
Oct 30 20:41:11.584282 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:11.584245    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="71d80089-5efc-425c-991c-31cf7f7854e8" path="/var/lib/kubelet/pods/71d80089-5efc-425c-991c-31cf7f7854e8/volumes"
Oct 30 20:41:11.584770 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:11.584646    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad" path="/var/lib/kubelet/pods/bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad/volumes"
Oct 30 20:41:11.658916 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:11.658876    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"]
Oct 30 20:41:11.763351 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:11.763314    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"]
Oct 30 20:41:12.053235 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:12.053201    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:12.213916 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:12.213868    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:12.506719 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:12.506635    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:16.659295 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:16.659249    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn" podUID="8cd6888d-2f0c-4594-997c-0ca022e1491f" containerName="payload-processing" containerID="cri-o://872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf" gracePeriod=25
Oct 30 20:41:16.764546 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:16.764455    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt" podUID="18a49027-c3a6-44b7-b1af-f0f19c6cf06e" containerName="payload-pre-processing" containerID="cri-o://697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f" gracePeriod=25
Oct 30 20:41:17.646037 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:17.646003    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:21.979177 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:21.979135    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:23.569558 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:23.569512    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:23.812536 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:23.812491    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:23.976398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:23.976305    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:24.522168 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:24.522071    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:25.159592 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:25.159555    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn" podUID="8cd6888d-2f0c-4594-997c-0ca022e1491f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:41:26.167109 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:26.167069    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt" podUID="18a49027-c3a6-44b7-b1af-f0f19c6cf06e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:41:28.215545 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:41:28.215509    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:41:29.301013 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:29.300966    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:31.441184 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:31.441147    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:31.626645 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:31.626600    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:31.823882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:31.823845    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:34.639778 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:34.639735    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:35.159521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:35.159477    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn" podUID="8cd6888d-2f0c-4594-997c-0ca022e1491f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:41:36.166909 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:36.166869    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt" podUID="18a49027-c3a6-44b7-b1af-f0f19c6cf06e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:41:36.931557 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:36.931486    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:41:37.020796 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.020766    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:41:37.050429 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.050398    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8cd6888d-2f0c-4594-997c-0ca022e1491f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cd6888d-2f0c-4594-997c-0ca022e1491f-plugins-config-volume\") pod \"8cd6888d-2f0c-4594-997c-0ca022e1491f\" (UID: \"8cd6888d-2f0c-4594-997c-0ca022e1491f\") "
Oct 30 20:41:37.050643 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.050525    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8cd6888d-2f0c-4594-997c-0ca022e1491f-kube-api-access-8sw4p\" (UniqueName: \"kubernetes.io/projected/8cd6888d-2f0c-4594-997c-0ca022e1491f-kube-api-access-8sw4p\") pod \"8cd6888d-2f0c-4594-997c-0ca022e1491f\" (UID: \"8cd6888d-2f0c-4594-997c-0ca022e1491f\") "
Oct 30 20:41:37.050842 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.050797    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd6888d-2f0c-4594-997c-0ca022e1491f-plugins-config-volume" pod "8cd6888d-2f0c-4594-997c-0ca022e1491f" (UID: "8cd6888d-2f0c-4594-997c-0ca022e1491f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:41:37.050938 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.050913    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8cd6888d-2f0c-4594-997c-0ca022e1491f-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:37.053050 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.053023    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd6888d-2f0c-4594-997c-0ca022e1491f-kube-api-access-8sw4p" pod "8cd6888d-2f0c-4594-997c-0ca022e1491f" (UID: "8cd6888d-2f0c-4594-997c-0ca022e1491f"). InnerVolumeSpecName "kube-api-access-8sw4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:41:37.152023 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.151988    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-kube-api-access-8b75g\" (UniqueName: \"kubernetes.io/projected/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-kube-api-access-8b75g\") pod \"18a49027-c3a6-44b7-b1af-f0f19c6cf06e\" (UID: \"18a49027-c3a6-44b7-b1af-f0f19c6cf06e\") "
Oct 30 20:41:37.152207 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.152105    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-plugins-config-volume\") pod \"18a49027-c3a6-44b7-b1af-f0f19c6cf06e\" (UID: \"18a49027-c3a6-44b7-b1af-f0f19c6cf06e\") "
Oct 30 20:41:37.152436 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.152406    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sw4p\" (UniqueName: \"kubernetes.io/projected/8cd6888d-2f0c-4594-997c-0ca022e1491f-kube-api-access-8sw4p\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:37.152566 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.152468    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-plugins-config-volume" pod "18a49027-c3a6-44b7-b1af-f0f19c6cf06e" (UID: "18a49027-c3a6-44b7-b1af-f0f19c6cf06e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:41:37.155913 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.155876    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-kube-api-access-8b75g" pod "18a49027-c3a6-44b7-b1af-f0f19c6cf06e" (UID: "18a49027-c3a6-44b7-b1af-f0f19c6cf06e"). InnerVolumeSpecName "kube-api-access-8b75g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:41:37.253836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.253710    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b75g\" (UniqueName: \"kubernetes.io/projected/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-kube-api-access-8b75g\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:37.253836 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.253749    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18a49027-c3a6-44b7-b1af-f0f19c6cf06e-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:41:37.600892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.600765    6015 generic.go:356] "Generic (PLEG): container finished" podID="18a49027-c3a6-44b7-b1af-f0f19c6cf06e" containerID="697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f" exitCode=0
Oct 30 20:41:37.600892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.600872    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"
Oct 30 20:41:37.601060 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.600998    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt" event={"ID":"18a49027-c3a6-44b7-b1af-f0f19c6cf06e","Type":"ContainerDied","Data":"697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f"}
Oct 30 20:41:37.601147 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.601060    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt" event={"ID":"18a49027-c3a6-44b7-b1af-f0f19c6cf06e","Type":"ContainerDied","Data":"2a7f569032fbca06697305f023b1019666687a88b1f6ea191051d6b0f7cb21f4"}
Oct 30 20:41:37.601147 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.601086    6015 scope.go:122] "RemoveContainer" containerID="697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f"
Oct 30 20:41:37.604916 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.603777    6015 generic.go:356] "Generic (PLEG): container finished" podID="8cd6888d-2f0c-4594-997c-0ca022e1491f" containerID="872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf" exitCode=0
Oct 30 20:41:37.604916 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.603858    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn" event={"ID":"8cd6888d-2f0c-4594-997c-0ca022e1491f","Type":"ContainerDied","Data":"872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf"}
Oct 30 20:41:37.604916 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.603912    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn" event={"ID":"8cd6888d-2f0c-4594-997c-0ca022e1491f","Type":"ContainerDied","Data":"a9f47bb7f64fe4edae74dd78d2891a7b97b3bad8ec894bb56d95ab855308be85"}
Oct 30 20:41:37.604916 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.603985    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"
Oct 30 20:41:37.616590 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.616566    6015 scope.go:122] "RemoveContainer" containerID="697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f"
Oct 30 20:41:37.616930 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:41:37.616909    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f\": container with ID starting with 697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f not found: ID does not exist" containerID="697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f"
Oct 30 20:41:37.616994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.616938    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f"} err="failed to get container status \"697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f\": rpc error: code = NotFound desc = could not find container \"697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f\": container with ID starting with 697196e0db521123cd08904e5cf859dee55b61e84cfc953d6017b73444394f2f not found: ID does not exist"
Oct 30 20:41:37.616994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.616955    6015 scope.go:122] "RemoveContainer" containerID="872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf"
Oct 30 20:41:37.625666 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.625644    6015 scope.go:122] "RemoveContainer" containerID="872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf"
Oct 30 20:41:37.625979 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:41:37.625958    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf\": container with ID starting with 872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf not found: ID does not exist" containerID="872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf"
Oct 30 20:41:37.626038 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.625987    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf"} err="failed to get container status \"872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf\": rpc error: code = NotFound desc = could not find container \"872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf\": container with ID starting with 872a99dcac8af4e3bf458390b2d56b8070fab3b7a43c7feaa6790fc1b3ddf5bf not found: ID does not exist"
Oct 30 20:41:37.757333 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.757301    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"]
Oct 30 20:41:37.804419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.804382    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-056a27-5d79f45b79-fvwnt"]
Oct 30 20:41:37.870380 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.870288    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"]
Oct 30 20:41:37.878870 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:37.878833    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-056a27-597b5d9878-66fxn"]
Oct 30 20:41:39.584848 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:39.584789    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18a49027-c3a6-44b7-b1af-f0f19c6cf06e" path="/var/lib/kubelet/pods/18a49027-c3a6-44b7-b1af-f0f19c6cf06e/volumes"
Oct 30 20:41:39.585333 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:39.585319    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8cd6888d-2f0c-4594-997c-0ca022e1491f" path="/var/lib/kubelet/pods/8cd6888d-2f0c-4594-997c-0ca022e1491f/volumes"
Oct 30 20:41:40.013680 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:40.013648    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:44.665453 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:44.665412    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:44.837671 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:44.837640    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:45.037038 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:45.036945    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:47.071969 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:47.071932    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"]
Oct 30 20:41:47.119122 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:47.119083    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-72e88600-s79cx"]
Oct 30 20:41:47.584653 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:47.584607    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8026536-8de7-4ae6-ac8e-9ac6871df721" path="/var/lib/kubelet/pods/c8026536-8de7-4ae6-ac8e-9ac6871df721/volumes"
Oct 30 20:41:50.102864 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:50.102800    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:54.521463 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:54.521407    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:56.138451 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:56.138390    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:56.463151 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:56.463055    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:56.623208 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:56.623170    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:57.087999 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:41:57.087879    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:41:58.214644 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:41:58.214609    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:42:01.887317 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:01.887277    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:03.428598 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:03.428561    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:03.637628 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:03.637588    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:03.837986 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:03.837948    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:04.266413 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:04.266325    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:05.172141 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:05.172099    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:07.302617 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:07.302576    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:09.222114 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:09.222075    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"]
Oct 30 20:42:09.268882 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:09.268844    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"]
Oct 30 20:42:09.360207 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:09.360171    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:12.497302 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:12.497239    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:16.475350 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:16.475266    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"]
Oct 30 20:42:16.755800 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:16.755708    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:16.956278 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:16.956231    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:17.614447 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:17.614406    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:21.475756 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:21.475706    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk" podUID="485ec003-a8a7-412f-949e-7a96cf8b521c" containerName="payload-pre-processing" containerID="cri-o://4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17" gracePeriod=25
Oct 30 20:42:24.243153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.243101    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main" containerID="cri-o://3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1" gracePeriod=45
Oct 30 20:42:24.289870 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.289784    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main" containerID="cri-o://103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965" gracePeriod=45
Oct 30 20:42:24.552687 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.552656    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 20:42:24.582774 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.582743    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 20:42:24.644181 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644142    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-model-cache\") pod \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") "
Oct 30 20:42:24.644181 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644182    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-home\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-home\") pod \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") "
Oct 30 20:42:24.644448 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644201    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tmp-dir\") pod \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") "
Oct 30 20:42:24.644448 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644243    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-kube-api-access-4qxl7\" (UniqueName: \"kubernetes.io/projected/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-kube-api-access-4qxl7\") pod \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") "
Oct 30 20:42:24.644448 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644265    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tls-certs\") pod \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") "
Oct 30 20:42:24.644448 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644309    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tls-certs\") pod \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") "
Oct 30 20:42:24.644448 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644327    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tmp-dir\") pod \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") "
Oct 30 20:42:24.644731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644456    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-dshm\") pod \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") "
Oct 30 20:42:24.644731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644515    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-model-cache\") pod \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") "
Oct 30 20:42:24.644731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644505    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-home" pod "69e9c36e-d8c7-4efa-88da-1b962ce16ddb" (UID: "69e9c36e-d8c7-4efa-88da-1b962ce16ddb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:24.644731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644520    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-model-cache" pod "69e9c36e-d8c7-4efa-88da-1b962ce16ddb" (UID: "69e9c36e-d8c7-4efa-88da-1b962ce16ddb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:24.644731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644570    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-kube-api-access-2vxtz\" (UniqueName: \"kubernetes.io/projected/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-kube-api-access-2vxtz\") pod \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") "
Oct 30 20:42:24.644731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644581    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tmp-dir" pod "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" (UID: "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:24.644731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644620    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tmp-dir" pod "69e9c36e-d8c7-4efa-88da-1b962ce16ddb" (UID: "69e9c36e-d8c7-4efa-88da-1b962ce16ddb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:24.644731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644692    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-home\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-home\") pod \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\" (UID: \"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088\") "
Oct 30 20:42:24.644731 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644726    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-dshm\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-dshm\") pod \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\" (UID: \"69e9c36e-d8c7-4efa-88da-1b962ce16ddb\") "
Oct 30 20:42:24.645276 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.644896    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-model-cache" pod "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" (UID: "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:24.645350 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.645329    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.645419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.645356    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.645419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.645371    6015 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-model-cache\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.645419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.645383    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.645419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.645388    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-home" pod "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" (UID: "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:24.645419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.645397    6015 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tmp-dir\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.647069 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.647019    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tls-certs" pod "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" (UID: "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:42:24.647188 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.647127    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-dshm" pod "69e9c36e-d8c7-4efa-88da-1b962ce16ddb" (UID: "69e9c36e-d8c7-4efa-88da-1b962ce16ddb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:24.647330 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.647312    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-kube-api-access-4qxl7" pod "69e9c36e-d8c7-4efa-88da-1b962ce16ddb" (UID: "69e9c36e-d8c7-4efa-88da-1b962ce16ddb"). InnerVolumeSpecName "kube-api-access-4qxl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:42:24.647407 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.647388    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tls-certs" pod "69e9c36e-d8c7-4efa-88da-1b962ce16ddb" (UID: "69e9c36e-d8c7-4efa-88da-1b962ce16ddb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:42:24.647446 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.647394    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-dshm" pod "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" (UID: "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:24.647619 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.647606    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-kube-api-access-2vxtz" pod "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" (UID: "6f0448ac-72d9-4fa4-bbe4-9cadfc4af088"). InnerVolumeSpecName "kube-api-access-2vxtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:42:24.746895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.746787    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.746895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.746846    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.746895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.746858    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vxtz\" (UniqueName: \"kubernetes.io/projected/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-kube-api-access-2vxtz\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.746895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.746868    6015 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088-home\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.746895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.746877    6015 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-dshm\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.746895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.746885    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qxl7\" (UniqueName: \"kubernetes.io/projected/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-kube-api-access-4qxl7\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.746895 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.746893    6015 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69e9c36e-d8c7-4efa-88da-1b962ce16ddb-tls-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:24.847042 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.847006    6015 generic.go:356] "Generic (PLEG): container finished" podID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerID="3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1" exitCode=0
Oct 30 20:42:24.847266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.847057    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"
Oct 30 20:42:24.847266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.847088    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" event={"ID":"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088","Type":"ContainerDied","Data":"3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1"}
Oct 30 20:42:24.847266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.847132    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h" event={"ID":"6f0448ac-72d9-4fa4-bbe4-9cadfc4af088","Type":"ContainerDied","Data":"4ec1eec3697ea425da9cd386e0bb0ba21bc9ef433d28b02660a4e912245bbe6f"}
Oct 30 20:42:24.847266 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.847154    6015 scope.go:122] "RemoveContainer" containerID="3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1"
Oct 30 20:42:24.848797 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.848771    6015 generic.go:356] "Generic (PLEG): container finished" podID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerID="103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965" exitCode=0
Oct 30 20:42:24.848969 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.848880    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" event={"ID":"69e9c36e-d8c7-4efa-88da-1b962ce16ddb","Type":"ContainerDied","Data":"103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965"}
Oct 30 20:42:24.848969 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.848908    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6" event={"ID":"69e9c36e-d8c7-4efa-88da-1b962ce16ddb","Type":"ContainerDied","Data":"9491ee881268c2ac53199782ce719fa42487c542a176648e23deed7e047e8720"}
Oct 30 20:42:24.849118 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.848970    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"
Oct 30 20:42:24.857663 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.857637    6015 scope.go:122] "RemoveContainer" containerID="3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1"
Oct 30 20:42:24.858079 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:42:24.858053    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1\": container with ID starting with 3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1 not found: ID does not exist" containerID="3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1"
Oct 30 20:42:24.858255 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.858221    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1"} err="failed to get container status \"3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1\": rpc error: code = NotFound desc = could not find container \"3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1\": container with ID starting with 3210acaea22d968125ec7668437c5b01691112a82678ea32b9c6148dfd311ec1 not found: ID does not exist"
Oct 30 20:42:24.858372 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.858257    6015 scope.go:122] "RemoveContainer" containerID="103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965"
Oct 30 20:42:24.867891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.867862    6015 scope.go:122] "RemoveContainer" containerID="103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965"
Oct 30 20:42:24.868257 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:42:24.868234    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965\": container with ID starting with 103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965 not found: ID does not exist" containerID="103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965"
Oct 30 20:42:24.868357 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:24.868266    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965"} err="failed to get container status \"103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965\": rpc error: code = NotFound desc = could not find container \"103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965\": container with ID starting with 103689c361ab4a37538868e4981b4fd70e0e5bf638492fb2fedca6dcf4018965 not found: ID does not exist"
Oct 30 20:42:25.004649 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:25.004559    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"]
Oct 30 20:42:25.026096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:25.026061    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/premium-w2-b0a183-kserve-6f79977f5-9f8z6"]
Oct 30 20:42:25.130714 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:25.130677    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"]
Oct 30 20:42:25.136243 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:25.136212    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b0a183/distinct-w2-b0a183-kserve-89fb89786-7rh2h"]
Oct 30 20:42:25.517026 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:25.516934    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk" podUID="485ec003-a8a7-412f-949e-7a96cf8b521c" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:42:25.584954 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:25.584916    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" path="/var/lib/kubelet/pods/69e9c36e-d8c7-4efa-88da-1b962ce16ddb/volumes"
Oct 30 20:42:25.585347 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:25.585333    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" path="/var/lib/kubelet/pods/6f0448ac-72d9-4fa4-bbe4-9cadfc4af088/volumes"
Oct 30 20:42:28.216108 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:42:28.216069    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:42:35.517691 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:35.517652    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk" podUID="485ec003-a8a7-412f-949e-7a96cf8b521c" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 20:42:37.386496 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.386458    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"]
Oct 30 20:42:37.386953 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.386684    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d" podUID="6a4a9b41-40f4-441f-a376-80da3002123d" containerName="maas-api" containerID="cri-o://814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f" gracePeriod=30
Oct 30 20:42:37.514259 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.514217    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:37.644288 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.644219    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 20:42:37.783318 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.783283    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a4a9b41-40f4-441f-a376-80da3002123d-kube-api-access-sj2tf\" (UniqueName: \"kubernetes.io/projected/6a4a9b41-40f4-441f-a376-80da3002123d-kube-api-access-sj2tf\") pod \"6a4a9b41-40f4-441f-a376-80da3002123d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") "
Oct 30 20:42:37.783524 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.783407    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a4a9b41-40f4-441f-a376-80da3002123d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4a9b41-40f4-441f-a376-80da3002123d-openshift-service-ca\") pod \"6a4a9b41-40f4-441f-a376-80da3002123d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") "
Oct 30 20:42:37.783524 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.783453    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-maas-api-tls\") pod \"6a4a9b41-40f4-441f-a376-80da3002123d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") "
Oct 30 20:42:37.783524 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.783478    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-metrics-certs\") pod \"6a4a9b41-40f4-441f-a376-80da3002123d\" (UID: \"6a4a9b41-40f4-441f-a376-80da3002123d\") "
Oct 30 20:42:37.783891 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.783857    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a4a9b41-40f4-441f-a376-80da3002123d-openshift-service-ca" pod "6a4a9b41-40f4-441f-a376-80da3002123d" (UID: "6a4a9b41-40f4-441f-a376-80da3002123d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:42:37.785789 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.785754    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-metrics-certs" pod "6a4a9b41-40f4-441f-a376-80da3002123d" (UID: "6a4a9b41-40f4-441f-a376-80da3002123d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:42:37.785988 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.785964    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a4a9b41-40f4-441f-a376-80da3002123d-kube-api-access-sj2tf" pod "6a4a9b41-40f4-441f-a376-80da3002123d" (UID: "6a4a9b41-40f4-441f-a376-80da3002123d"). InnerVolumeSpecName "kube-api-access-sj2tf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:42:37.786058 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.785973    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-maas-api-tls" pod "6a4a9b41-40f4-441f-a376-80da3002123d" (UID: "6a4a9b41-40f4-441f-a376-80da3002123d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:42:37.885092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.885056    6015 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-maas-api-tls\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:37.885092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.885084    6015 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a4a9b41-40f4-441f-a376-80da3002123d-metrics-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:37.885092 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.885096    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj2tf\" (UniqueName: \"kubernetes.io/projected/6a4a9b41-40f4-441f-a376-80da3002123d-kube-api-access-sj2tf\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:37.885363 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.885106    6015 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4a9b41-40f4-441f-a376-80da3002123d-openshift-service-ca\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:37.921506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.921408    6015 generic.go:356] "Generic (PLEG): container finished" podID="6a4a9b41-40f4-441f-a376-80da3002123d" containerID="814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f" exitCode=0
Oct 30 20:42:37.921506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.921464    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"
Oct 30 20:42:37.921506 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.921472    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d" event={"ID":"6a4a9b41-40f4-441f-a376-80da3002123d","Type":"ContainerDied","Data":"814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f"}
Oct 30 20:42:37.921794 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.921523    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d" event={"ID":"6a4a9b41-40f4-441f-a376-80da3002123d","Type":"ContainerDied","Data":"584b343d4ba1d4b296abad2e704c3fd5313c23ea20c13242bcf4b30c23db5fed"}
Oct 30 20:42:37.921794 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.921546    6015 scope.go:122] "RemoveContainer" containerID="814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f"
Oct 30 20:42:37.932349 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.932326    6015 scope.go:122] "RemoveContainer" containerID="814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f"
Oct 30 20:42:37.932713 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:42:37.932675    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f\": container with ID starting with 814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f not found: ID does not exist" containerID="814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f"
Oct 30 20:42:37.932799 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:37.932722    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f"} err="failed to get container status \"814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f\": rpc error: code = NotFound desc = could not find container \"814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f\": container with ID starting with 814d84af82333e20dbc92a4a5ea4f698823e28c8d0ed13ef92caafa4c2c79c4f not found: ID does not exist"
Oct 30 20:42:38.077555 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:38.077519    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"]
Oct 30 20:42:38.081779 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:38.081751    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b0a183-695b56c545-xv76d"]
Oct 30 20:42:38.600995 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:38.600959    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:39.072799 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:39.072746    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:39.363796 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:39.363711    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:39.585743 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:39.585701    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6a4a9b41-40f4-441f-a376-80da3002123d" path="/var/lib/kubelet/pods/6a4a9b41-40f4-441f-a376-80da3002123d/volumes"
Oct 30 20:42:40.064261 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:40.064217    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:41.731349 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.731317    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 20:42:41.825221 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.825181    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/485ec003-a8a7-412f-949e-7a96cf8b521c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/485ec003-a8a7-412f-949e-7a96cf8b521c-plugins-config-volume\") pod \"485ec003-a8a7-412f-949e-7a96cf8b521c\" (UID: \"485ec003-a8a7-412f-949e-7a96cf8b521c\") "
Oct 30 20:42:41.825441 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.825262    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/485ec003-a8a7-412f-949e-7a96cf8b521c-kube-api-access-vtz4c\" (UniqueName: \"kubernetes.io/projected/485ec003-a8a7-412f-949e-7a96cf8b521c-kube-api-access-vtz4c\") pod \"485ec003-a8a7-412f-949e-7a96cf8b521c\" (UID: \"485ec003-a8a7-412f-949e-7a96cf8b521c\") "
Oct 30 20:42:41.825593 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.825569    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485ec003-a8a7-412f-949e-7a96cf8b521c-plugins-config-volume" pod "485ec003-a8a7-412f-949e-7a96cf8b521c" (UID: "485ec003-a8a7-412f-949e-7a96cf8b521c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:42:41.827523 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.827492    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485ec003-a8a7-412f-949e-7a96cf8b521c-kube-api-access-vtz4c" pod "485ec003-a8a7-412f-949e-7a96cf8b521c" (UID: "485ec003-a8a7-412f-949e-7a96cf8b521c"). InnerVolumeSpecName "kube-api-access-vtz4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:42:41.927041 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.927000    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtz4c\" (UniqueName: \"kubernetes.io/projected/485ec003-a8a7-412f-949e-7a96cf8b521c-kube-api-access-vtz4c\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:41.927041 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.927036    6015 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/485ec003-a8a7-412f-949e-7a96cf8b521c-plugins-config-volume\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:41.946291 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.946254    6015 generic.go:356] "Generic (PLEG): container finished" podID="485ec003-a8a7-412f-949e-7a96cf8b521c" containerID="4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17" exitCode=0
Oct 30 20:42:41.946485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.946297    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"
Oct 30 20:42:41.946485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.946341    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk" event={"ID":"485ec003-a8a7-412f-949e-7a96cf8b521c","Type":"ContainerDied","Data":"4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17"}
Oct 30 20:42:41.946485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.946394    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk" event={"ID":"485ec003-a8a7-412f-949e-7a96cf8b521c","Type":"ContainerDied","Data":"840331a8106691664679533c87c525a6da6055413347b6c657a38f073c7a9f74"}
Oct 30 20:42:41.946485 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.946416    6015 scope.go:122] "RemoveContainer" containerID="4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17"
Oct 30 20:42:41.958201 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.958178    6015 scope.go:122] "RemoveContainer" containerID="4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17"
Oct 30 20:42:41.958914 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:42:41.958883    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17\": container with ID starting with 4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17 not found: ID does not exist" containerID="4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17"
Oct 30 20:42:41.959010 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:41.958927    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17"} err="failed to get container status \"4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17\": rpc error: code = NotFound desc = could not find container \"4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17\": container with ID starting with 4b60afe0374e978354808b7776f7999fd5d13c37792485c941142d2b2cdcaa17 not found: ID does not exist"
Oct 30 20:42:42.105559 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:42.105472    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"]
Oct 30 20:42:42.110316 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:42.110284    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-b0a183-5875d95f79-b8tkk"]
Oct 30 20:42:43.583881 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:43.583837    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="485ec003-a8a7-412f-949e-7a96cf8b521c" path="/var/lib/kubelet/pods/485ec003-a8a7-412f-949e-7a96cf8b521c/volumes"
Oct 30 20:42:46.222621 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:46.222584    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:46.461127 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:46.461092    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:48.050784 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:48.050743    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:48.252005 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:48.251971    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:48.419551 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:48.419454    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:48.578905 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:48.578873    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"]
Oct 30 20:42:48.579096 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:48.579042    6015 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy" containerID="cri-o://745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc" gracePeriod=30
Oct 30 20:42:48.616554 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:48.616520    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:50.169981 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:50.169943    6015 patch_prober.go:29] interesting pod/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 20:42:50.170398 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:50.170005    6015 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 20:42:51.878095 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:51.878057    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-mthrm_153f2d0a-9487-484f-a0db-bde52c9e3d95/manager/0.log"
Oct 30 20:42:53.833135 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.833105    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 20:42:53.943535 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.943441    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-socket\") pod \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") "
Oct 30 20:42:53.943535 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.943490    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-certs\") pod \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") "
Oct 30 20:42:53.943535 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.943518    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istiod-ca-cert\") pod \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") "
Oct 30 20:42:53.943892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.943544    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-kube-api-access-g6fg8\" (UniqueName: \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-kube-api-access-g6fg8\") pod \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") "
Oct 30 20:42:53.943892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.943568    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-envoy\") pod \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") "
Oct 30 20:42:53.943892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.943586    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-credential-socket\") pod \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") "
Oct 30 20:42:53.943892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.943670    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-data\") pod \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") "
Oct 30 20:42:53.943892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.943711    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-podinfo\") pod \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") "
Oct 30 20:42:53.943892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.943736    6015 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-token\" (UniqueName: \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-token\") pod \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\" (UID: \"a1e325c6-3061-4f98-80e8-3d95a9c2896c\") "
Oct 30 20:42:53.943892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.943763    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-socket" pod "a1e325c6-3061-4f98-80e8-3d95a9c2896c" (UID: "a1e325c6-3061-4f98-80e8-3d95a9c2896c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:53.943892 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.943783    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-certs" pod "a1e325c6-3061-4f98-80e8-3d95a9c2896c" (UID: "a1e325c6-3061-4f98-80e8-3d95a9c2896c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:53.944334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.944031    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-credential-socket" pod "a1e325c6-3061-4f98-80e8-3d95a9c2896c" (UID: "a1e325c6-3061-4f98-80e8-3d95a9c2896c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:53.944334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.944088    6015 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:53.944334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.944108    6015 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-workload-certs\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:53.944334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.944117    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-data" pod "a1e325c6-3061-4f98-80e8-3d95a9c2896c" (UID: "a1e325c6-3061-4f98-80e8-3d95a9c2896c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:53.944334 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.944228    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istiod-ca-cert" pod "a1e325c6-3061-4f98-80e8-3d95a9c2896c" (UID: "a1e325c6-3061-4f98-80e8-3d95a9c2896c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:42:53.946195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.946165    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-podinfo" pod "a1e325c6-3061-4f98-80e8-3d95a9c2896c" (UID: "a1e325c6-3061-4f98-80e8-3d95a9c2896c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 20:42:53.946195 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.946165    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-kube-api-access-g6fg8" pod "a1e325c6-3061-4f98-80e8-3d95a9c2896c" (UID: "a1e325c6-3061-4f98-80e8-3d95a9c2896c"). InnerVolumeSpecName "kube-api-access-g6fg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:42:53.946761 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.946729    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-envoy" pod "a1e325c6-3061-4f98-80e8-3d95a9c2896c" (UID: "a1e325c6-3061-4f98-80e8-3d95a9c2896c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:42:53.946761 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:53.946742    6015 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-token" pod "a1e325c6-3061-4f98-80e8-3d95a9c2896c" (UID: "a1e325c6-3061-4f98-80e8-3d95a9c2896c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:42:54.021034 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.020997    6015 generic.go:356] "Generic (PLEG): container finished" podID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerID="745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc" exitCode=0
Oct 30 20:42:54.021214 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.021049    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" event={"ID":"a1e325c6-3061-4f98-80e8-3d95a9c2896c","Type":"ContainerDied","Data":"745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc"}
Oct 30 20:42:54.021214 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.021080    6015 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"
Oct 30 20:42:54.021214 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.021101    6015 scope.go:122] "RemoveContainer" containerID="745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc"
Oct 30 20:42:54.021383 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.021092    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t" event={"ID":"a1e325c6-3061-4f98-80e8-3d95a9c2896c","Type":"ContainerDied","Data":"d422645b6b4fb2f07f3618c391d57607b8b2d2680ebaae2eecdaffa18b4f7478"}
Oct 30 20:42:54.030875 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.030851    6015 scope.go:122] "RemoveContainer" containerID="4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27"
Oct 30 20:42:54.039231 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.039208    6015 scope.go:122] "RemoveContainer" containerID="745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc"
Oct 30 20:42:54.039510 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:42:54.039485    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc\": container with ID starting with 745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc not found: ID does not exist" containerID="745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc"
Oct 30 20:42:54.039590 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.039526    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc"} err="failed to get container status \"745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc\": rpc error: code = NotFound desc = could not find container \"745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc\": container with ID starting with 745fe5f26dcc0b8645ef5d15861471d5c1fedd33b28846cdcfc93749560224bc not found: ID does not exist"
Oct 30 20:42:54.039590 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.039553    6015 scope.go:122] "RemoveContainer" containerID="4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27"
Oct 30 20:42:54.039849 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:42:54.039828    6015 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27\": container with ID starting with 4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27 not found: ID does not exist" containerID="4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27"
Oct 30 20:42:54.039902 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.039856    6015 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27"} err="failed to get container status \"4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27\": rpc error: code = NotFound desc = could not find container \"4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27\": container with ID starting with 4c625e9c84f66fd63fe543e7b8ff969cb62969678841dbe20c31a6f776e2cc27 not found: ID does not exist"
Oct 30 20:42:54.045388 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.045364    6015 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istiod-ca-cert\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:54.045488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.045389    6015 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6fg8\" (UniqueName: \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-kube-api-access-g6fg8\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:54.045488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.045400    6015 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-envoy\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:54.045488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.045409    6015 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-credential-socket\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:54.045488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.045417    6015 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-data\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:54.045488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.045426    6015 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-podinfo\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:54.045488 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.045434    6015 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1e325c6-3061-4f98-80e8-3d95a9c2896c-istio-token\") on node \"ip-10-0-130-34.us-west-2.compute.internal\" DevicePath \"\""
Oct 30 20:42:54.119500 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.119462    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:42:54.178581 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.178546    6015 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"]
Oct 30 20:42:54.183347 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:54.183302    6015 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b0a183-openshift-default-657d79bfdc-zh69t"]
Oct 30 20:42:55.583314 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:42:55.583275    6015 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" path="/var/lib/kubelet/pods/a1e325c6-3061-4f98-80e8-3d95a9c2896c/volumes"
Oct 30 20:42:58.215079 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:42:58.215039    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:43:05.552540 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:05.552497    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:08.933626 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:08.933586    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6fdd445db4-vlfvk_60c7458a-3ee5-486a-bd51-d7d231aa02d8/maas-api/0.log"
Oct 30 20:43:13.404930 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:13.404881    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-mthrm_153f2d0a-9487-484f-a0db-bde52c9e3d95/manager/0.log"
Oct 30 20:43:15.340501 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:15.340468    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fc9b9cc5d-qz44t_9319fb61-cad5-4b5d-83d1-71b1818c98e0/kube-auth-proxy/0.log"
Oct 30 20:43:17.960215 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:17.960181    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-7q7rc_5516ade0-61c9-4e1d-97e7-19a3050d0b06/main/0.log"
Oct 30 20:43:18.391825 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:18.391777    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c9mbd_54ecc0f3-f365-4507-87dd-45746d79c442/main/0.log"
Oct 30 20:43:18.641419 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:18.641387    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-6zjkp_b1c0347b-370b-4d32-b4c4-480b87849789/main/0.log"
Oct 30 20:43:28.214996 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:43:28.214956    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:43:29.086906 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.086871    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-476dj/must-gather-ml48s"]
Oct 30 20:43:29.087393 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087374    6015 cpu_manager.go:414] "containerMap: removing container" podUID="485ec003-a8a7-412f-949e-7a96cf8b521c" containerName="payload-pre-processing"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087394    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="485ec003-a8a7-412f-949e-7a96cf8b521c" containerName="payload-pre-processing"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087418    6015 cpu_manager.go:414] "containerMap: removing container" podUID="3e8dca38-1009-42b6-b5e4-e635ba755eaa" containerName="payload-pre-processing"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087424    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e8dca38-1009-42b6-b5e4-e635ba755eaa" containerName="payload-pre-processing"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087433    6015 cpu_manager.go:414] "containerMap: removing container" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087438    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087447    6015 cpu_manager.go:414] "containerMap: removing container" podUID="18a49027-c3a6-44b7-b1af-f0f19c6cf06e" containerName="payload-pre-processing"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087454    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18a49027-c3a6-44b7-b1af-f0f19c6cf06e" containerName="payload-pre-processing"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087463    6015 cpu_manager.go:414] "containerMap: removing container" podUID="79d59373-dd54-4099-9aa8-95b27ebb3ca8" containerName="payload-processing"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087467    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79d59373-dd54-4099-9aa8-95b27ebb3ca8" containerName="payload-processing"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087475    6015 cpu_manager.go:414] "containerMap: removing container" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087482    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087493    6015 cpu_manager.go:414] "containerMap: removing container" podUID="23b6d445-7b28-4f9f-aecc-874ff146099e" containerName="main"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087498    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23b6d445-7b28-4f9f-aecc-874ff146099e" containerName="main"
Oct 30 20:43:29.087502 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087503    6015 cpu_manager.go:414] "containerMap: removing container" podUID="9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087508    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087522    6015 cpu_manager.go:414] "containerMap: removing container" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087526    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087534    6015 cpu_manager.go:414] "containerMap: removing container" podUID="8cd6888d-2f0c-4594-997c-0ca022e1491f" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087538    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8cd6888d-2f0c-4594-997c-0ca022e1491f" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087545    6015 cpu_manager.go:414] "containerMap: removing container" podUID="41370641-dd3b-4349-b909-64bec93bc378" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087550    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="41370641-dd3b-4349-b909-64bec93bc378" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087556    6015 cpu_manager.go:414] "containerMap: removing container" podUID="b0ae637e-40fc-4735-ae1f-d572a97b528d" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087560    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0ae637e-40fc-4735-ae1f-d572a97b528d" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087569    6015 cpu_manager.go:414] "containerMap: removing container" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087573    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087578    6015 cpu_manager.go:414] "containerMap: removing container" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087582    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087590    6015 cpu_manager.go:414] "containerMap: removing container" podUID="c8026536-8de7-4ae6-ac8e-9ac6871df721" containerName="revoke-keys"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087594    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8026536-8de7-4ae6-ac8e-9ac6871df721" containerName="revoke-keys"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087599    6015 cpu_manager.go:414] "containerMap: removing container" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087604    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087610    6015 cpu_manager.go:414] "containerMap: removing container" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087614    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087619    6015 cpu_manager.go:414] "containerMap: removing container" podUID="f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087623    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087632    6015 cpu_manager.go:414] "containerMap: removing container" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087636    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087645    6015 cpu_manager.go:414] "containerMap: removing container" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087649    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087654    6015 cpu_manager.go:414] "containerMap: removing container" podUID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087659    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087666    6015 cpu_manager.go:414] "containerMap: removing container" podUID="71d80089-5efc-425c-991c-31cf7f7854e8" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087670    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="71d80089-5efc-425c-991c-31cf7f7854e8" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087679    6015 cpu_manager.go:414] "containerMap: removing container" podUID="0d2a4c5c-7251-45b8-a501-fea6546bc5d7" containerName="maas-api"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087683    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d2a4c5c-7251-45b8-a501-fea6546bc5d7" containerName="maas-api"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087692    6015 cpu_manager.go:414] "containerMap: removing container" podUID="6a4a9b41-40f4-441f-a376-80da3002123d" containerName="maas-api"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087697    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6a4a9b41-40f4-441f-a376-80da3002123d" containerName="maas-api"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087711    6015 cpu_manager.go:414] "containerMap: removing container" podUID="bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087716    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087723    6015 cpu_manager.go:414] "containerMap: removing container" podUID="e3ba1452-be29-49f4-923f-a535693624fe" containerName="maas-api"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087727    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e3ba1452-be29-49f4-923f-a535693624fe" containerName="maas-api"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087733    6015 cpu_manager.go:414] "containerMap: removing container" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087738    6015 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087793    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8026536-8de7-4ae6-ac8e-9ac6871df721" containerName="revoke-keys"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087801    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087822    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087827    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="f1df9240-cf13-4bb4-ae92-54fa1ccfe3fb" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087833    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087838    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d00166f-5e3a-416e-8b21-d5a30638c025" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087844    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="d1ceebb6-a0c0-4b43-8261-6bb6144d754b" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087851    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="71d80089-5efc-425c-991c-31cf7f7854e8" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087857    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d2a4c5c-7251-45b8-a501-fea6546bc5d7" containerName="maas-api"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087863    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="6a4a9b41-40f4-441f-a376-80da3002123d" containerName="maas-api"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087869    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb7f2e65-2c06-478b-a0a2-ac63e9fc11ad" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087874    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="e3ba1452-be29-49f4-923f-a535693624fe" containerName="maas-api"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087879    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087883    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="485ec003-a8a7-412f-949e-7a96cf8b521c" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087889    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e8dca38-1009-42b6-b5e4-e635ba755eaa" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087894    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1e325c6-3061-4f98-80e8-3d95a9c2896c" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087899    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="18a49027-c3a6-44b7-b1af-f0f19c6cf06e" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087905    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="79d59373-dd54-4099-9aa8-95b27ebb3ca8" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087910    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="696e031c-3499-48ce-a9dd-dc02da84d95e" containerName="istio-proxy"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087914    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="23b6d445-7b28-4f9f-aecc-874ff146099e" containerName="main"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087919    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fe73112-57a7-47e2-9a5e-3e2eb20e0c4c" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087924    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="69e9c36e-d8c7-4efa-88da-1b962ce16ddb" containerName="main"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087929    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="8cd6888d-2f0c-4594-997c-0ca022e1491f" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087935    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="41370641-dd3b-4349-b909-64bec93bc378" containerName="payload-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087940    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0ae637e-40fc-4735-ae1f-d572a97b528d" containerName="payload-pre-processing"
Oct 30 20:43:29.087976 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.087946    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f0448ac-72d9-4fa4-bbe4-9cadfc4af088" containerName="main"
Oct 30 20:43:29.090017 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.088080    6015 memory_manager.go:365] "RemoveStaleState removing state" podUID="88448a71-1695-4c8e-9eea-7acf648d9f0f" containerName="istio-proxy"
Oct 30 20:43:29.091236 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.091220    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-476dj/must-gather-ml48s"
Oct 30 20:43:29.136074 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.136036    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:29.186003 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.185971    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-476dj\"/\"default-dockercfg-lglxs\""
Oct 30 20:43:29.191138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.191096    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-476dj\"/\"openshift-service-ca.crt\""
Oct 30 20:43:29.191138 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.191112    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-476dj\"/\"kube-root-ca.crt\""
Oct 30 20:43:29.192521 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.192487    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-476dj/must-gather-ml48s"]
Oct 30 20:43:29.287241 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.287207    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3685fa75-95b8-4e17-b517-11deb7695a88-must-gather-output\") pod \"must-gather-ml48s\" (UID: \"3685fa75-95b8-4e17-b517-11deb7695a88\") " pod="openshift-must-gather-476dj/must-gather-ml48s"
Oct 30 20:43:29.287648 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.287264    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdbh5\" (UniqueName: \"kubernetes.io/projected/3685fa75-95b8-4e17-b517-11deb7695a88-kube-api-access-pdbh5\") pod \"must-gather-ml48s\" (UID: \"3685fa75-95b8-4e17-b517-11deb7695a88\") " pod="openshift-must-gather-476dj/must-gather-ml48s"
Oct 30 20:43:29.316010 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.315969    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:43:29.388961 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.388876    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbh5\" (UniqueName: \"kubernetes.io/projected/3685fa75-95b8-4e17-b517-11deb7695a88-kube-api-access-pdbh5\") pod \"must-gather-ml48s\" (UID: \"3685fa75-95b8-4e17-b517-11deb7695a88\") " pod="openshift-must-gather-476dj/must-gather-ml48s"
Oct 30 20:43:29.389124 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.388978    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3685fa75-95b8-4e17-b517-11deb7695a88-must-gather-output\") pod \"must-gather-ml48s\" (UID: \"3685fa75-95b8-4e17-b517-11deb7695a88\") " pod="openshift-must-gather-476dj/must-gather-ml48s"
Oct 30 20:43:29.389274 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.389259    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3685fa75-95b8-4e17-b517-11deb7695a88-must-gather-output\") pod \"must-gather-ml48s\" (UID: \"3685fa75-95b8-4e17-b517-11deb7695a88\") " pod="openshift-must-gather-476dj/must-gather-ml48s"
Oct 30 20:43:29.447530 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.447494    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdbh5\" (UniqueName: \"kubernetes.io/projected/3685fa75-95b8-4e17-b517-11deb7695a88-kube-api-access-pdbh5\") pod \"must-gather-ml48s\" (UID: \"3685fa75-95b8-4e17-b517-11deb7695a88\") " pod="openshift-must-gather-476dj/must-gather-ml48s"
Oct 30 20:43:29.705877 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:29.705761    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-476dj/must-gather-ml48s"
Oct 30 20:43:30.073493 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:30.073459    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-476dj/must-gather-ml48s"]
Oct 30 20:43:30.076590 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:43:30.076557    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3685fa75_95b8_4e17_b517_11deb7695a88.slice/crio-c85cbe317f3f7a6168835812ad38dfbee1fd56600d4ea2c1bbee869cec881c75 WatchSource:0}: Error finding container c85cbe317f3f7a6168835812ad38dfbee1fd56600d4ea2c1bbee869cec881c75: Status 404 returned error can't find the container with id c85cbe317f3f7a6168835812ad38dfbee1fd56600d4ea2c1bbee869cec881c75
Oct 30 20:43:30.078363 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:30.078343    6015 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:43:30.195867 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:30.195828    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-476dj/must-gather-ml48s" event={"ID":"3685fa75-95b8-4e17-b517-11deb7695a88","Type":"ContainerStarted","Data":"c85cbe317f3f7a6168835812ad38dfbee1fd56600d4ea2c1bbee869cec881c75"}
Oct 30 20:43:37.241783 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:37.241748    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-476dj/must-gather-ml48s" event={"ID":"3685fa75-95b8-4e17-b517-11deb7695a88","Type":"ContainerStarted","Data":"1a08a4fc5fdc0a85245a63e5bb18f6f0a871b5843572edccd61c4f9ca6e4af1e"}
Oct 30 20:43:38.248276 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:38.248238    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-476dj/must-gather-ml48s" event={"ID":"3685fa75-95b8-4e17-b517-11deb7695a88","Type":"ContainerStarted","Data":"cbf6be50214d5127abc3d16a4da73cb290e6f8e017adaca0ea10a41ae74284fd"}
Oct 30 20:43:38.359970 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:38.359911    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-476dj/must-gather-ml48s" podStartSLOduration=2.340356163 podStartE2EDuration="9.35989415s" totalImagesPullingTime="7.019537987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:38.358690892 +0000 UTC m=+4680.901498157" watchObservedRunningTime="2026-10-30 20:43:38.35989415 +0000 UTC m=+4680.902701414"
Oct 30 20:43:39.420592 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:39.420560    6015 scope.go:122] "RemoveContainer" containerID="0047ee7b79456ae3fb47d35a9426d1fd237ba64c9925880b190e2b07b5f28ade"
Oct 30 20:43:40.335093 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:40.335052    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xmsrx_36c3af0c-ac42-4a11-9fbd-ebc48700b9d2/global-pull-secret-syncer/0.log"
Oct 30 20:43:42.321626 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:42.321581    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log"
Oct 30 20:43:43.550888 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:43.550822    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-34.us-west-2.compute.internal_ceea1ff964927afa3d04bca3afe81300/haproxy/0.log"
Oct 30 20:43:49.891996 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:49.891902    6015 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"]
Oct 30 20:43:49.895366 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:49.895345    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:49.946240 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:49.946194    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j795s\"/\"kube-root-ca.crt\""
Oct 30 20:43:49.993327 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:49.993295    6015 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j795s\"/\"default-dockercfg-bsc74\""
Oct 30 20:43:49.993520 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:49.993386    6015 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j795s\"/\"openshift-service-ca.crt\""
Oct 30 20:43:49.994786 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:49.994764    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"]
Oct 30 20:43:50.002009 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.001981    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-podres\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.002174 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.002019    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-sys\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.002174 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.002120    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-lib-modules\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.002174 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.002167    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-proc\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.002323 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.002262    6015 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drltb\" (UniqueName: \"kubernetes.io/projected/e861b571-9562-4192-8c01-cd9fa06463c1-kube-api-access-drltb\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.104411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.103754    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-proc\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.104411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.103845    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drltb\" (UniqueName: \"kubernetes.io/projected/e861b571-9562-4192-8c01-cd9fa06463c1-kube-api-access-drltb\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.104411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.103868    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-proc\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.104411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.103969    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-podres\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.104411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.103993    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-sys\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.104411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.104027    6015 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-lib-modules\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.104411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.104146    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-lib-modules\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.104411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.104207    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-podres\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.104411 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.104212    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e861b571-9562-4192-8c01-cd9fa06463c1-sys\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.163340 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.163261    6015 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drltb\" (UniqueName: \"kubernetes.io/projected/e861b571-9562-4192-8c01-cd9fa06463c1-kube-api-access-drltb\") pod \"perf-node-gather-daemonset-d6nr7\" (UID: \"e861b571-9562-4192-8c01-cd9fa06463c1\") " pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.207884 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.207847    6015 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:50.589388 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:50.589357    6015 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"]
Oct 30 20:43:50.592492 ip-10-0-130-34 kubenswrapper[6015]: W1030 20:43:50.592447    6015 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode861b571_9562_4192_8c01_cd9fa06463c1.slice/crio-2998a3766e440289910ef1bcfe8badaa89283bb28ca14c08d6e763890bc1fdb3 WatchSource:0}: Error finding container 2998a3766e440289910ef1bcfe8badaa89283bb28ca14c08d6e763890bc1fdb3: Status 404 returned error can't find the container with id 2998a3766e440289910ef1bcfe8badaa89283bb28ca14c08d6e763890bc1fdb3
Oct 30 20:43:51.318685 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:51.318631    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7" event={"ID":"e861b571-9562-4192-8c01-cd9fa06463c1","Type":"ContainerStarted","Data":"406e38616bae3c8c93c6226b347d84e62f4d6bb4436bb2971b7cb99dda2fefe7"}
Oct 30 20:43:51.319153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:51.318712    6015 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7" event={"ID":"e861b571-9562-4192-8c01-cd9fa06463c1","Type":"ContainerStarted","Data":"2998a3766e440289910ef1bcfe8badaa89283bb28ca14c08d6e763890bc1fdb3"}
Oct 30 20:43:51.319153 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:51.318791    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:51.348639 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:51.348588    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-mthrm_153f2d0a-9487-484f-a0db-bde52c9e3d95/manager/0.log"
Oct 30 20:43:51.431287 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:51.431219    6015 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7" podStartSLOduration=2.43119952 podStartE2EDuration="2.43119952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:43:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:51.429240099 +0000 UTC m=+4693.972047361" watchObservedRunningTime="2026-10-30 20:43:51.43119952 +0000 UTC m=+4693.974006781"
Oct 30 20:43:55.030714 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:55.030674    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66c776c2-e010-4b9b-a18e-dda1140e60d7/alertmanager/0.log"
Oct 30 20:43:55.463148 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:55.463115    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66c776c2-e010-4b9b-a18e-dda1140e60d7/config-reloader/0.log"
Oct 30 20:43:55.897552 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:55.897514    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66c776c2-e010-4b9b-a18e-dda1140e60d7/kube-rbac-proxy-web/0.log"
Oct 30 20:43:56.329691 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:56.329647    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66c776c2-e010-4b9b-a18e-dda1140e60d7/kube-rbac-proxy/0.log"
Oct 30 20:43:56.763484 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:56.763404    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66c776c2-e010-4b9b-a18e-dda1140e60d7/kube-rbac-proxy-metric/0.log"
Oct 30 20:43:57.219651 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:57.219620    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66c776c2-e010-4b9b-a18e-dda1140e60d7/prom-label-proxy/0.log"
Oct 30 20:43:57.336697 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:57.336667    6015 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j795s/perf-node-gather-daemonset-d6nr7"
Oct 30 20:43:57.678994 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:57.678962    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66c776c2-e010-4b9b-a18e-dda1140e60d7/init-config-reloader/0.log"
Oct 30 20:43:58.215855 ip-10-0-130-34 kubenswrapper[6015]: E1030 20:43:58.215799    6015 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x4n4k" containerName="extractor"
Oct 30 20:43:58.554970 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:58.554935    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-8mlrg_586f9624-2168-4588-a01f-9cc483699682/kube-state-metrics/0.log"
Oct 30 20:43:58.977730 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:58.977643    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-8mlrg_586f9624-2168-4588-a01f-9cc483699682/kube-rbac-proxy-main/0.log"
Oct 30 20:43:59.410010 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:59.409981    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-8mlrg_586f9624-2168-4588-a01f-9cc483699682/kube-rbac-proxy-self/0.log"
Oct 30 20:43:59.847194 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:59.847169    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56bf65fd49-dp7vl_69657bb8-0d16-4aeb-9388-5184569b0114/metrics-server/0.log"
Oct 30 20:43:59.897648 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:43:59.897619    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fc9b9cc5d-qz44t_9319fb61-cad5-4b5d-83d1-71b1818c98e0/kube-auth-proxy/0.log"
Oct 30 20:44:00.279473 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:00.279374    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-k7fj6_0ca4d390-4036-4689-8ecd-d13b149ff6ba/monitoring-plugin/0.log"
Oct 30 20:44:02.000992 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:02.000957    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n47m6_063cbdd6-3453-4a82-9532-6a846ad94f0e/node-exporter/0.log"
Oct 30 20:44:02.114441 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:02.114389    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fc9b9cc5d-qz44t_9319fb61-cad5-4b5d-83d1-71b1818c98e0/kube-auth-proxy/0.log"
Oct 30 20:44:02.438586 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:02.438558    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n47m6_063cbdd6-3453-4a82-9532-6a846ad94f0e/kube-rbac-proxy/0.log"
Oct 30 20:44:02.869473 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:02.869442    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n47m6_063cbdd6-3453-4a82-9532-6a846ad94f0e/init-textfile/0.log"
Oct 30 20:44:04.719002 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:04.718974    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-tc9dv_c4e772a6-140b-4d72-873d-ac43b9b2f0a3/kube-rbac-proxy-main/0.log"
Oct 30 20:44:05.148869 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:05.148801    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-tc9dv_c4e772a6-140b-4d72-873d-ac43b9b2f0a3/kube-rbac-proxy-self/0.log"
Oct 30 20:44:05.578307 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:05.578276    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-tc9dv_c4e772a6-140b-4d72-873d-ac43b9b2f0a3/openshift-state-metrics/0.log"
Oct 30 20:44:05.859355 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:05.859266    6015 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4nbnr_3d5f797e-c46a-47fd-9a80-570a83b355ff/konnectivity-agent/0.log" limit=1024
Oct 30 20:44:06.021778 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:06.021745    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_093352f2-f461-49b8-9afb-a26e2e361a39/prometheus/0.log"
Oct 30 20:44:06.453493 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:06.453464    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_093352f2-f461-49b8-9afb-a26e2e361a39/config-reloader/0.log"
Oct 30 20:44:06.883304 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:06.883270    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_093352f2-f461-49b8-9afb-a26e2e361a39/thanos-sidecar/0.log"
Oct 30 20:44:07.332610 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:07.332566    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_093352f2-f461-49b8-9afb-a26e2e361a39/kube-rbac-proxy-web/0.log"
Oct 30 20:44:07.527114 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:07.527073    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-mthrm_153f2d0a-9487-484f-a0db-bde52c9e3d95/manager/0.log"
Oct 30 20:44:07.767970 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:07.767878    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_093352f2-f461-49b8-9afb-a26e2e361a39/kube-rbac-proxy/0.log"
Oct 30 20:44:08.208835 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:08.208514    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_093352f2-f461-49b8-9afb-a26e2e361a39/kube-rbac-proxy-thanos/0.log"
Oct 30 20:44:08.644570 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:08.644539    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_093352f2-f461-49b8-9afb-a26e2e361a39/init-config-reloader/0.log"
Oct 30 20:44:09.813668 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:09.813632    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-mthrm_153f2d0a-9487-484f-a0db-bde52c9e3d95/manager/0.log"
Oct 30 20:44:10.428721 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:10.428673    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66fcfc996c-q2j5x_cc905dc2-23e8-4237-8874-f2e9d8ae50a4/telemeter-client/0.log"
Oct 30 20:44:10.857137 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:10.857105    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66fcfc996c-q2j5x_cc905dc2-23e8-4237-8874-f2e9d8ae50a4/reload/0.log"
Oct 30 20:44:11.286785 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:11.286694    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66fcfc996c-q2j5x_cc905dc2-23e8-4237-8874-f2e9d8ae50a4/kube-rbac-proxy/0.log"
Oct 30 20:44:11.726624 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:11.726557    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dffbb6d99-swjqg_d78689c3-56b1-481c-9ef7-bf81b9a9679e/thanos-query/0.log"
Oct 30 20:44:12.158959 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:12.158900    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dffbb6d99-swjqg_d78689c3-56b1-481c-9ef7-bf81b9a9679e/kube-rbac-proxy-web/0.log"
Oct 30 20:44:12.589472 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:12.589434    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dffbb6d99-swjqg_d78689c3-56b1-481c-9ef7-bf81b9a9679e/kube-rbac-proxy/0.log"
Oct 30 20:44:13.028556 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:13.028471    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dffbb6d99-swjqg_d78689c3-56b1-481c-9ef7-bf81b9a9679e/prom-label-proxy/0.log"
Oct 30 20:44:13.461660 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:13.461619    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dffbb6d99-swjqg_d78689c3-56b1-481c-9ef7-bf81b9a9679e/kube-rbac-proxy-rules/0.log"
Oct 30 20:44:13.891703 ip-10-0-130-34 kubenswrapper[6015]: I1030 20:44:13.891658    6015 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dffbb6d99-swjqg_d78689c3-56b1-481c-9ef7-bf81b9a9679e/kube-rbac-proxy-metrics/0.log"